Image display unit and projection optical system

ABSTRACT

An intermediate image of an image from the LCD module  142  is deflected by reflection mirrors M 1  and M 2  via zoom automatic focus control system (g) and then is formed on diffusion glass  131  via relay lens (b) and reflection mirrors M 3  and M 4 . The LCD image is projected on the retina of eyeballs via eyepiece lens  132  by the light flux diffused at an order of ±20 degrees by diffusion glass  131 . One side of the eyepiece lens  132  close to the crystal balls  2  has an aspherical shape of a Conic surface and a Conic coefficient of the Conic surface is −1 and less. Thereby the optical system that has a viewing angle of 60 degrees and over and has a small aberration can be obtained.

TECHNICAL FIELD

This invention relates to an image display device that is used inproximity to at least one of eyes and a projection optical system thatis arranged in front of at least one of the eyes of a user and projectsan image on the eyeball of the user.

BACKGROUND ART

As an image display device, there are many image devices available onthe market like a TV, PC, Projector, video camera, cellular phone etc,but there is a limit to a size in these conventional image displaydevices, so an image of a wide area that human eyes are actually able tosee cannot be obtained from these image display devices. Further, as aportable image display device, an eyeglass-type image display andhead-mounted image display devices that are called a wearable displaydevice have been known.

As for the wearable image display, as shown in FIG. 40, a method inwhich small half mirror 40 is arranged at a portion of field of view andan image output from image output element 39 such as a plasma displaydevice, LCD etc is deflected by half mirror 40 via projection opticalsystem 38, and the image is projected on a retina has been known. Thisis a method that uses the half mirror, so that the image output fromimage output element 39 looks like floating on a portion of field ofview (a first type). However, as for a viewing angle, only an order of afew degrees is obtainable, so that this method is a candidate for use indisplaying information of a screen of the cellular phone etc.

Also, as for a method for getting a little bit larger image informationthan that of the cellular phone, there is a method as shown in FIG. 6(b) in which an image output from image output element 39 is projectedon the retina of the eyeball via a plurality of reflection surfaces andprojection optical system 42 by arranging large optical element 41 infront of at least one of eyeballs.

In such the method, a relatively large viewing angle (order of 15-30degrees) is obtained, but only an image display device of which field ofview is completely shielded has been proposed. Thus, a second-type imagedisplay device that is arranged detachably in front of one eye of twoeyes and used as an image display device of a wearable PC and athird-type image display device in which a same image display device isseparately arranged with respect to both eyes and used instead of a TVand projector have been proposed.

The foregoing three types of the image display device have been expectedas a wearable image display device in place of the cellular phone,note-size PC, TV and projector of the prior art. In fact, these imagedisplay devices have an advantage in “wearable”, but a size of field ofview of them is actually not very different from one of the conventionaldisplay devices and, when considering difficulty in wearing, eyestraindue to a blocked field of view, a weight mounted over ears and head etc,they have a shortcoming that these disadvantages are conspicuous.

This invention is made in view of these circumstances and an object ofthis invention is to provide an image display device that is wearable orusable in proximity to at least one of eyes having a large viewing angleclose to field of view with which a user sees, and a projection opticalsystem that is arranged in front of user's eyes and projects an image onthe eyeball.

DISCLOSURE OF INVENTION

A first invention for achieving the above object is an image displaydevice that includes an optoelectric element of emitting light in atwo-dimensional way having a display surface orthogonal to a directionof emitted light flux and a fisheye-type optical system that projectslight flux emitted from the optoelectric element inside at least one ofeyeballs of a user and has an angle of field of view of 60 degrees andover, wherein the image display device is worn in front of the eyeballand the fisheye-type optical system forms an intermediate image and aclosest optical element of optical element arranged toward the eyeballfrom a position of forming the intermediate image to the eyeball is anaspherical optical element of a single lens element and a far surfaceshape of the optical element from the eyeball has a aspherical shape ofa Conic surface such that the light flux entering a pupil of the eyeballenters a far surface of the optical element from the eyeballapproximately at right angles and a Conic coefficient of the Conicsurface is −1 and less.

A second invention for achieving the above object is the fisheye-typeoptical system set forth in the first invention, wherein a secondoptical element of optical elements constituting the image displaydevice from the eyeball is made up of a single lens element and asurface shape of a far surface of the optical element from the eyeballhas a shape such that the light flux entering the pupil of the eyeballenters a far surface of the optical element from the eyeballapproximately at right angles.

A third invention for achieving the above object is the image displaydevice set forth in any of the first or second invention, wherein thefisheye-type optical system has a first lens group that includes a relayoptical system, and an eyepiece lens system that projects theintermediate image formed by the first lens group inside the eyeball.

A fourth invention for achieving the above object is the image displaydevice set forth in the third invention, wherein the first lens groupincludes at least one or more aspheric optical element and over.

A fifth invention for achieving the above object is the image displaydevice set forth in any of the third or fourth invention, wherein thefirst lens group includes at least one curved mirror that correctstelecentricity.

A sixth invention for achieving the above object is the image displaydevice set forth in any of the first through fifth inventions, whereinthe image display device includes an image composite device thatcomposites first image information and second image informationdifferent from the first image information and outputs information ofthe composite image to the optoelectric element.

A seventh invention for achieving the above object is the image displaydevice set forth in the sixth invention, wherein the image compositedevice includes a function that, when light flux emitted from theoptoelectric element is influenced by distortion produced by thefisheye-type optical system, implements image process of givingdistortion to at least one of the first image information and the secondimage information beforehand to correct the distortion such that afaithful image can be projected.

An eighth invention for achieving the above object is the image displaydevice set forth in any of the sixth through eighth inventions, whereinthe image composite device includes an image composite device controllerthat controls information of the composite image to be output to theoptoelectric element such that an area of compositing at least one ofthe first image information and the second image information, andanother image information does not overlap beyond a predetermined area.

A ninth invention for achieving the above object is the image displaydevice set forth in any of the sixth through eighth inventions, whereinat least one of the first image information and the second imageinformation includes at least one of information output from a videoimage, a DVD image and a high vision image.

A tenth invention for achieving the above object is the image displaydevice set forth in the sixth through ninth inventions, wherein at leastone of the first image information and the second image informationincludes image information output from a processing computing device.

A eleventh invention for achieving the above object is the image displaydevice set forth in the tenth invention, wherein the processingcomputing device is connected with a keyboard to enter desiredinformation into the processing computing device and the image outputinformation includes information input to the keyboard.

A twelfth invention for achieving the above object is the image displaydevice set forth in the eleventh invention, wherein the keyboard is aportable keyboard attached to a hand.

A thirteenth invention for achieving the above object is the imagedisplay device set forth in the twelfth invention, wherein the portablekeyboard includes an electromagnetic element attached to a thumb and anelectromagnetic detecting sensor attached to other fingers, and furtherincludes a control device that recognizes information of a distance anddirection between the thumb and the other fingers from a state of anelectromagnetic field detected by the electromagnetic detecting sensorand gives a specific sign corresponding to the information of thedistance and direction.

A fourteenth invention for achieving the above object is the imagedisplay device set forth in the twelfth invention, wherein the portablekeyboard includes a pressure detecting sensor that is attached to eachfinger and a control device that gives a specific sign on a basis ofinformation of each finger's pressure detected by the pressure detectingsensor.

A fifteenth invention for achieving the above object is the imagedisplay device set forth in the tenth invention, wherein the processingcomputing device converts a voice sound or a non-voice sound input to amicrophone or a headphone into a specific sign corresponding to thesound and outputs an image in correspondence to the specific sign as theimage output information.

A sixteenth invention for achieving the above object is the imagedisplay device set forth in any of the first through fifteenthinventions, wherein the fisheye-type optical system includes an opticalimage composite device that optically composites a plurality of imagesoutput from a plurality of optoelectric elements and projects, and formsa plurality of images on the retina inside the eyeball.

A seventeenth invention for achieving the above object is the imaged isplay device set forth in the sixth invention, wherein the optical imagecomposite device includes an optical zoom device that has a variablemagnification of at least 2× and over with respect to a single image,and an optical image composite device controller that controls theoptical zoom device such that an area of compositing the single imageand other image does not overlap beyond a predetermined area.

A eighteenth invention for achieving the above object is an imagedisplay device for both eyes, wherein the image display device set forthin any of the first through seventeenth inventions is separatelyarranged to a right eyeball and a left eyeball respectively and furtherincludes an adjustment device that is capable of adjusting a spacebetween each fisheye-type optical system of right and left eyeballscorresponding to a space between eyeballs of the user.

A nineteenth invention for achieving the above object is an imagedisplay device for both eyes, wherein the image display device set forthin any of the first through seventeenth inventions includes a splittingoptical system that splits light flux emitted from one of theoptoelectric elements into a plurality of light flux and thefisheye-type optical system that is separately arranged every each splitlight flux, and further includes an adjustment device that is capable ofadjusting a space between each fisheye-type optical system correspondingto a space between eyeballs of the user.

A twentieth invention for achieving the above object is the imagedisplay device set forth in any of the first through seventeenthinventions, wherein the image display device is arranged to at least oneof a right eyeball and a left eyeball

A twenty-first invention for achieving the above object is an imagedisplay device for both eyes, wherein the image display device set forthin any of the first through seventeenth inventions includes both of theoptoelectric element and the fisheye-type optical system respectivelyand an image splitting/image composite optical device that splits eachlight flux emitted from the two optoelectric elements for a righteyeball and a left eyeball and composites the split light flux emittedfrom a different optoelectric element for the right eyeball and the lefteyeball respectively, and a switching member that switches the imagesplitting/image composite optical system between a state of anin-operation and a state of an out-of-service.

A twenty-second invention for achieving the above object is the imagedisplay device set forth in any of the first through twenty-firstinventions and further includes at least one of an earthquake detectingsensor, a level measurement/level adjustment device and a fixed device.

A twenty-third invention for achieving the above object is the imagedisplay device set forth in any of the first through twenty-secondinventions that further includes a timer device, and a movement devicethat moves the image display device in accordance with a timer device oran output of the timer device.

A twenty-fourth invention for achieving the above object is the imagedisplay device set forth in any of the first through twenty-thirdinventions, wherein an angle of divergence of light flux traveled fromthe intermediate image to the eyeball from the intermediate image has alarger angle than a scope of varying angles of incidence of allprinciple rays passing through a centre of a pupil of the eyeball uponthe surface of forming the intermediate image when a position of a pupilof the eyeball varies due to a lateral shift of the eyeball.

A twenty-fifth invention for achieving the above object is the imagedisplay device set forth in any of the first through twenty-fourthinventions that further includes a light diffusion element of diffusinglight at a position of forming the intermediate image or in proximity toits position.

A twenty-sixth invention for achieving the above object is the imagedisplay device set forth in the twenty-fifth invention, wherein thelight diffusion element is a transparent diffusion substrate coated on atransparent substrate with a particle of a metal oxide or a metalliccarbide with a particle diameter controlled by an order of a micron.

A twenty-seventh invention for achieving the above object is the imagedisplay device set forth in the twenty-sixth invention, wherein theparticle is at least one of silicon carbide, chromic oxide, tin oxide,titanium oxide, magnesium oxide and aluminum oxide and the transparentdiffusion substrate is a polyester film.

A twenty-eighth invention for achieving the above object is the imagedisplay device set forth in any of the first through twenty-seventhinventions, wherein a part of the image display device is capable ofbeing placed at a contact with a face of a user and further at least theoptoelectric element and the fisheye-type optical system are supportedby a supporting member rather than a user and its supporting membersupports an unit including the optoelectric element and the fisheye-typeoptical system movably in response to a movement of a user's face.

A twenty-ninth invention for achieving the above object is the imagedisplay device set forth in the twenty-eighth invention, wherein thesupporting member is capable of moving around toward directions of sixaxes at will.

A thirtieth invention for achieving the above object is the imagedisplay device set forth in any of the twenty-eighth throughtwenty-ninth inventions, wherein a position of centre of gravity of theimage display device or its proximity to the position is supported bythe supporting member.

A thirty-first invention for achieving the above object is the imagedisplay device set forth in any of the twenty-eighth through thirtiethinventions, wherein the supporting member includes a plurality ofarticular structures members and weight members, and a flexible linkingmember that links the unit including the fisheye-type optical system andthe optoelectric element to the weight member, and a holding member thatis arranged at the articular structure and holds the linking member,wherein the linking member has low friction against a movement of thelinking member.

A thirty-second invention for achieving the above object is the imagedisplay device set forth in any of the first through thirty-firstinventions that further includes a reducing device of a sickness inVirtual Environment that detects an image of a moving landscape like aflowing landscape and processes the image such that the image looksstill during a predetermined period of time.

A thirty-third invention for achieving the above object is the imagedisplay device set forth in the thirty-second invention that furtherincludes a selection device that selects use or non-use of the reducingdevice of the sickness in Virtual Environment.

A thirty-fourth invention for achieving the above object is the imagedisplay device set forth in any of the thirty-second or thirty-thirdinvention, wherein the reducing device of the sickness in VirtualEnvironment divides the image into an edge image block and a centreimage block and computes an amount of a lateral shift in an image withineach block during a predetermined period of time and judges that thereis a hand shake or a lateral movement of an screen when an image of theedge image block and an image of the centre image block shift toward thesame direction, and processes an image in such a way that makes a wholescreen thereof look still by shifting the entire image by the sameamount as a movement amount toward a direction opposite a direction of amoving image such that an image does not move laterally during apredetermined period of time.

A thirty-fifth invention for achieving the above object is a projectionoptical system that is arranged in front of a user and projects an imageon an eyeball of a user, and has an angle of view of 60 degrees andover, wherein a closest optical element of optical elements constitutingthe projection optical system to the eyeball is an aspherical opticalelement of a single lens element and a far surface shape of the opticalelement from the eyeball has an aspherical shape of a Conic surface suchthat the light flux incident upon a pupil of the eyeball enters a farsurface of the optical element from the eyeball approximately at rightangles and a Conic coefficient of the Conic surface is less than −1.

A thirty-sixth invention for achieving the above object is theprojection optical system set forth in the thirty-fifth invention,wherein a second optical element of optical elements constituting theprojection optical system from the eyeball is made up of a single lenselement and a far surface shape of the optical element from the eyeballhas a shape such that the light flux incident upon a pupil of theeyeball enters a far surface of the optical element from the eyeballapproximately at right angles.

A thirty-seventh invention for achieving the above object is theprojection optical system set forth in the thirty-fifth invention,wherein the aspherical optical element is arranged at a position closestto the eyeball.

A thirty-eighth invention for achieving the above object is theprojection optical system set forth in any of the thirty-fifth-throughthirty-seventh inventions, wherein an angle of divergence of light fluxtraveled from the image to the eyeball from the image is larger than ascope of varying angles of incidence of all principle rays passingthrough a centre of a pupil of the eyeball upon the surface of formingthe image when a position of a pupil of the eyeball varies due to alateral shift of the eyeball.

A thirty-ninth invention for achieving the above object is an imagedisplay device that includes an optoelectric element of emitting lightin a two-dimensional way having a display surface orthogonal to adirection of emitted light flux and a fisheye-type optical system thatprojects the light flux emitted from the optoelectric element inside atleast one of eyeballs of a user and has an viewing angle of 60 degreesand over, wherein the image display device is worn in front of theeyeball and the fisheye-type optical system forms an intermediate imageand a light diffusion element is arranged at a position of forming theintermediate image or in proximity to the position and at least one ofoptical elements arranged toward the eyeball from the position offorming the intermediate image is an aspherical optical element of whichat least one surface has an aspherical shape of a Conic surface and theimage display device further includes a supporting member that supportsat least the fisheye-type optical system and the optoelectric elementmovably so as to follow a user's movement.

A fortieth invention for achieving the above object is an image displaydevice that includes an optoelectric element to output image data andprojects an image output from the optoelectric element on a retinainside at least one of eyes of a user via at least two reflectionsurfaces with a curved surface, wherein a first reflection surface witha curved surface shape that deflects light flux before entering aneyeball is a first elliptic mirror and a first focus point of the firstelliptic mirror lies in proximity to a crystal ball of an eyeball and asecond focus point of the first elliptic mirror lies between the firstelliptic mirror and a second reflection surface with a curved surface,and a flat surface passing through a center of a line linking the firstand second focus points orthogonal to the line and the reflectionsurface of the first elliptic mirror are configured to intersect.

A forty-first invention for achieving the above object is the imagedisplay device set forth in the fortieth invention, wherein the secondreflection surface with the curved surface is a second elliptic mirrorand an image on the optoelectric element is configured to be projectedon the retina inside the eyeball by a correction optical systemincluding the second elliptic mirror.

A forty-second invention for achieving the above object is the imagedisplay device set forth in any of the thirty-ninth or fortiethinvention, wherein the second reflection surface with the curved surfaceis a second elliptic mirror and the position of the second focus pointof the first elliptic mirror and the position of the first focus pointof the second elliptic mirror are arranged so as to be substantially inalignment, and a flat surface that passes through a center of a linelinking the first and second focus points of the second elliptic mirrorand is orthogonal to the line and the reflection surface of the secondelliptic mirror are configured to intersect.

A forty-third invention for achieving the above object is the imagedisplay device set forth in the forty-second invention, wherein thefirst and second focus points of the first elliptic mirror and the firstand second focus points of the second elliptic mirror are arranged so asto line substantially in a straight line.

A forty-fourth invention for achieving the above object is the imagedisplay device set forth in the forty-second invention, wherein afisheye-type optical system is arranged on an optical path between thesecond elliptic mirror and the optoelectric element.

A forty-fifth invention for achieving the above object is the imagedisplay device set forth in the forty-fourth invention, wherein thefisheye-type optical system includes a function that supplies light fluxincluding image data to an image detection area of the retina due to amovement of the crystal ball responsive to a turn of the eyeball.

A forty-sixth invention for achieving the above object is the imagedisplay device set forth in any of the forty-second through forty-fifthinventions, wherein a correction optical system to correct a position offorming an image in a direction of an optical axis is arranged at aportion where the second focus point of the first elliptic mirror andthe first focus point of the second elliptic mirror are configured to besubstantially in alignment.

A forty-seventh invention for achieving the above object is the imagedisplay device set forth in any of the fortieth through forty-sixthinventions, wherein curvature of the first and second elliptic mirrorsare substantially equal.

A forty-eighth invention for achieving the above object is the imagedisplay device set forth in any of the fortieth through forty-seventhinventions, wherein the image display device is configured to bearranged to at least one of the right eyeball and the left eyeball.

A forty-ninth invention for achieving the above object is an imagedisplay device made up of two image display devices set forth in any ofthe fortieth through forty-seventh inventions, wherein the two imagedisplay devices are separately arranged to a right eyeball and a lefteyeball respectively and their positions thereof are made adjustablecorresponding to a space between eyeballs.

A fiftieth invention for achieving the above object is the image displaydevice set forth in any of the fortieth through forty-ninth inventions,wherein the optoelectric element is a liquid crystal display device ofemitting light in a two-dimensional way perpendicular to a direction ofemitted light flux.

A fifty-first invention for achieving the above object is an imagedisplay device that includes a first fisheye-type optical system thatprojects a predetermined wide image on a first optoelectric element ofreceiving light in a two-dimensional way perpendicular to a direction ofreceiving light flux, and an optical system that outputs image datareceived by the first optoelectric element from a second optoelectricelement of emitting light in a two-dimensional way perpendicular to adirection of emitted light flux and projects an image output from thesecond optoelectric element on a retina inside at least one of eyeballsvia a second fisheye-type optical system and a reflection surface with acurved surface.

A fifty-second invention for achieving the above object is the imagedisplay device set forth in the fifty-first invention, wherein thesecond fisheye-type optical system includes a function that supplieslight flux including image data to an image detection area of the retinadue to a movement of the crystal ball corresponding to a turn of theeyeball.

A fifty-third invention for achieving the above object is the imagedisplay device set forth in any of the fifty-first or fifty-secondinvention, wherein the reflection surface with the curved surface isarranged at a position substantially conjugate with the retina of theeyeball and is a curved surface that corrects deterioration oftelecentricity produced by the second fisheye-type optical system.

A fifty-fourth invention for achieving the above object is the imagedisplay device set forth in any of the fifty-first or fifty-secondinvention, wherein the reflection surface with the curved surface isarranged at the position substantially conjugate with the retina of theeyeball and is a curved surface that corrects deterioration oftelecentricity produced by the second fisheye-type optical system.

A fifty-fifth invention for achieving the above object is the imagedisplay device set forth in any of the fifty-first through fifty-fourthinventions, wherein the reflection surface with the curved surface isformed by a fθ-type mirror with at least two surfaces and optical axesof both fθ-type mirrors are made parallel with each other and a focuspoint of one of the fθ-type mirrors is arranged in proximity to thecrystal ball of the eyeballs, and the other focus point thereof isarranged in proximity to the second fisheye-type optical system.

A fifty-sixth invention for achieving the above object is the imagedisplay device set forth in any of the fifty-first through fifty-fourthinventions, wherein the reflection surface with the curved surface isformed by a fθ-type mirror with at least two surfaces and optical axesof both fθ-type mirrors are made parallel with each other, and the imagedisplay device further includes functions that relay the focus point ofone of fθ-type mirrors in proximity to the crystal ball of the eyeballsby way of a third fisheye-type optical system, and relay the other focuspoint thereof in proximity to the second optoelectric element by way ofthe second fisheye-type optical system.

A fifty-seventh invention for achieving the above object is the imagedisplay device set forth in any of the fifty-first through fifty-thirdinventions, wherein the reflection surface with the curved surface isformed by an elliptic mirror with at least two surfaces and one of thetwo focus points of the elliptic mirror with two surfaces is arrangedsubstantially at the same position as that of the other thereof and allfocus points are arranged substantially in a straight line.

A fifty-eighth invention for achieving the above object is an imagedisplay device made up of two image display devices set forth in any ofthe fifty-first through fifty-seventh inventions, wherein the two imagedisplay devices are separately arranged to right and left eyeballsrespectively and a space between the two image display devices is madeadjustable corresponding to a space between right and left eyes suchthat a space between the first fisheye-type optical systems of the twoimage display devices and a space between eyeballs become equal.

A fifty-ninth invention for achieving the above object is the imagedisplay device set forth in any of the fifty-first through fifty-seventhinventions, wherein the image display device is configured to bearranged to at least one of right and left eyeballs.

A sixtieth invention for achieving the above object is an image displaydevice made up of two image display devices set forth in any of thefortieth through fifty-seventh inventions, wherein the two image displaydevices are separately arranged to right and left eyeballs respectivelyand their positions thereof are made adjustable corresponding to aspacing between eyeballs.

A sixty-first invention for achieving the above object is the imagedisplay device set forth in any of the fifty-first through sixtiethinventions, wherein the second optoelectric element is a liquid crystaldisplay device of emitting light in a two-dimensional way.

A sixty-second invention for achieving the above object is the imagedisplay device set forth in any of the fifty-first through sixty-firstinventions, wherein the first optoelectric element is an image sensor ofreceiving light in a two-dimensional way.

A sixty-third invention for achieving the above object is an imagedisplay device that includes functions that project a predetermined wideimage on a first optoelectric element with a spherical surface ofreceiving light in a two-dimensional way perpendicular to a direction ofreceiving light flux and image data received by the first optoelectricelement output from a second optoelectric element with a sphericalsurface of emitting light in a two-dimensional way perpendicular to adirection of emitted light flux, and project the image data on a retinainside at least one of eyeballs via a reflection surface with a curvedsurface.

A sixty-fourth invention for achieving the above object is the imagedisplay device set forth in the sixty-third invention, wherein the firstoptoelectric element includes a positive lens arranged on a sphericalsurface and an image sensor arranged on the spherical surface, and thesecond optoelectric element includes a positive lens arranged on aspherical surface and a display unit arranged on the spherical surface.

A sixty-fifth invention for achieving the above object is an imagedisplay device that includes a first fisheye-type optical system thatprojects a predetermined wide image on a first optoelectric element ofreceiving light in a two-dimensional way perpendicular to a direction ofreceived light flux, and a control device that outputs image datareceived by the first optoelectric element from a second optoelectricelement of emitting light in a two-dimensional way perpendicular to adirection of emitted light flux and implements a desired control whenprojecting the image data from the second optoelectric element on aretinal inside at least one of eyeballs via a second fisheye-typeoptical system.

A sixty-sixth invention for achieving the above object is the imagedisplay device set forth in the sixty-fifth invention, wherein thesecond fisheye-type optical system includes a function that supplieslight flux including image data to an image detection area of the retinadue to the crystal ball corresponding to a turn of the eyeball.

A sixty-seventh invention for achieving the above object is the imagedisplay device set forth in any of the sixty-fifth or sixty-sixthinvention that further includes a reflection surface with a curvedsurface in the second fisheye-type optical system, wherein thereflection surface with the curved surface is arranged at a positionsubstantially conjugate with the retina inside the eyeball and is asurface that corrects curvature of field produced by the secondfisheye-type optical system.

A sixty-eighth invention for achieving the above object is the imagedisplay device set forth in any of the sixty-fifth or sixty-sixthinvention that further includes a reflection surface with a curvedsurface that is arranged at a position substantially conjugate with theretina inside the eyeball in the second fisheye-type optical system, andthat corrects deterioration of telecentricity produced by the secondfisheye-type optical system.

A sixty-ninth invention for achieving the above object is the imagedisplay device set forth in any of the sixty-fifth through sixty-eighthinventions that further includes a fθ-type mirror with at least twosurfaces, wherein optical axes of both fθ-type mirrors are made parallelwith each other and a focus point of one of the fθ-type mirrors isarranged in proximity to the crystal ball inside at least one ofeyeballs and the focus point of the other thereof is arranged inproximity to the second fisheye-type optical system.

A seventieth invention for achieving the above object is the imagedisplay device set forth in any of the sixty-fifth through sixty-eighthinventions that further includes a deflecting mirror between the secondoptical system and the retina inside at least one of eyeballs, whereinthe deflecting mirror is formed by the fθ-type mirror with at least twosurfaces and optical axes of both fθ-type mirrors are made parallel witheach other, and functions that relay a focus point of one of fθ-typemirrors in proximity to the crystal ball of the eyeball by way of athird fisheye-type optical system and relay the focus point of the otherthereof in proximity to the second optoelectric element by way of thesecond fisheye-type optical system.

A seventy-first invention for achieving the above object is the imagedisplay device set forth in any of the sixty-fifth through sixty-eighthinventions, wherein the deflecting mirror is formed by an ellipticmirror with at least two surfaces and one of two focus points of the twoelliptic mirrors is arranged substantially at the same position as thatof the other thereof and all focus points thereof are arrangedsubstantially in a straight line.

A seventy-second invention for achieving the above object is the imagedisplay device set forth in any of the sixty-fifth through seventy-firstinventions, wherein the control device includes at least any of a focusadjustment device to focus on the predetermined wide image or a devicethat controls a scope of outputting a wide image at will.

A seventy-third invention for achieving the above object is the imagedisplay device set forth in any of the sixty-fifth throughseventy-second inventions, wherein the control device includes an imagecomposite device that composites first image information input from anexternal other than the image display device and second imageinformation input from the first optoelectric element and outputsinformation of the composite image from the second optoelectric element.

A seventy-fourth invention for achieving the above object is the imagedisplay device set forth in the seventy-third invention, wherein theimage composite device includes functions that correct the first imageinformation based upon information of distortion produced by the firstfisheye-type optical system, and composite the corrected first imageinformation and the second image information.

A seventy-fifth invention for achieving the above object is the imagedisplay device set forth in any of the seventy-third or seventy-fourthinvention, wherein the first image information includes information ofan image output from a video.

A seventy-sixth invention for achieving the above object is the imagedisplay device set forth in the seventy-fifth invention, wherein a videoimage input device that supplies the information of the output videoimage is fixed onto the image display device detachably.

A seventy-seventh invention for achieving the above object is the imagedisplay device set forth in any of the seventy-third throughseventy-sixth inventions, wherein the first image information includesimage information output from a computer.

A seventy-eighth invention for achieving the above object is the imagedisplay device set forth in any of the seventy-third throughseventy-seventh inventions, wherein the first image information includeskeyboard information input to a computer.

A seventy-ninth invention for achieving the above object is the imagedisplay device set forth in any of the seventy-third throughseventy-eighth inventions, wherein the first image information includesinformation input to a portable keyboard attached to a hand.

An eightieth invention for achieving the above object is the imagedisplay device set forth in the seventy-ninth invention, wherein theinformation input to the portable keyboard includes image informationobtained by detecting information of an electromagnetic element attachedto a thumb with an electromagnetic detection sensor attached to otherfingers and converting the information of the electromagnetic elementinto information of a distance and direction between the thumb and theother fingers.

An eighty-first invention for achieving the above object is the imagedisplay device set forth in any of the seventy-ninth or eightiethinvention, wherein the information input to the portable keyboardincludes image information obtained by detecting information of eachfinger's pressure against an object with a pressure detection sensorattached to each finger and converting the information of each finger'spressure into recognizable information as an image.

An eighty-second invention for achieving the above object is the imagedisplay device set forth in any of the seventy-third througheighty-first inventions, wherein the first image information includesimage information made up of a character into which a voiced ornon-voice sound input to a microphone or headphone is converted.

An eighty-third invention for achieving the above object is an imagedisplay device made up of two image display devices set forth in any ofthe sixty-third through eighty-second inventions, wherein the two imagedisplay devices are separately arranged to right and left eyeballsrespectively and a space between both image display devices is madeadjustable corresponding to a space between right and left eyeballs suchthat a space between the first fisheye-type optical systems of the twoimage display devices and a space between eyeballs are made equal.

An eighty-fourth invention for achieving the above object is the imagedisplay device set forth in any of the sixty-third through eighty-secondinventions, wherein the image display device is arranged to at least oneof right and left eyeballs.

An eighty-fifth invention for achieving the above object is an imagedisplay device made up of two image display devices set forth in any ofthe sixty-third through eighty-second inventions, wherein the two imagedisplay devices are separately arranged to right and left eyeballsrespectively and their positions thereof are made adjustablecorresponding to a space between eyeballs.

An eighty-sixth invention for achieving the above object is the imagedisplay device set forth in any of the sixty-third through eighty-fifthinventions, wherein at least the second optoelectric element isseparately arranged to right and left eyeballs, and the firstoptoelectric element and the first fisheye-type optical system areshared for right and left eyeballs.

An eighty-seventh invention for achieving the above object is the imagedisplay device set forth in the eighty-sixth invention, whereininformation input to the first optoelectric element is converted intoinformation of a position corresponding to width of both eyes and theposition information is output to the second optoelectric element forboth eyes as different information corresponding to each eye.

An eighty-eighth invention for achieving the above object is an imagedisplay device that includes a control device that controls an imagefrom a first optoelectric element which is to be formed by projectingand forming light emitted from a first optoelectric element of emittinglight in a two-dimensional way perpendicular to a direction of emittedlight flux on a retinal inside at least one of eyeballs via a firstfisheye-type optical system and a reflection surface with a curved.

An eighty-ninth invention for achieving the above object is the imagedisplay device set forth in the eighty-eighth invention, wherein thefirst fisheye-type optical system includes a function that supplieslight flux including image data to an image detection area of a retinadue to a movement of a crystal ball corresponding to a turn of theeyeball.

A ninetieth invention for achieving the above object is the imagedisplay device set forth in any of the eighty-eighth or eighty-ninthinvention, wherein the reflection surface with the curved surface isarranged at a position substantially conjugate with the retina inside atleast one of eyeballs and is a curved surface that corrects curvature offield produced by the first fisheye-type optical system.

A ninety-first invention for achieving the above object is the imagedisplay device set forth in any of the eighty-eighth or eight-ninthinvention, wherein the reflection surface with the curved surface isarranged at a position almost conjugate with a retina of an eyeball andis a curved surface that corrects deterioration of telecentricityproduced by the first fisheye-type optical system.

A ninety-second invention for achieving the above object is the imagedisplay device set forth in any of the ninetieth or ninety-firstinvention that further includes a fθ-type mirror with at least twosurfaces, wherein optical axes of both fθ-type mirrors are made paralleland a focus point of one of the fθ-type mirrors is arranged in proximityto the crystal ball of the eyeball and the focus point of the otherthereof is arranged in proximity to the first fisheye-type opticalsystem.

A ninety-third invention for achieving the above object is the imagedisplay device set forth in any of the eighty-eighth throughninety-first inventions that further includes a deflecting mirrorbetween the first fisheye-type optical system and the retina inside theeyeball, wherein the deflecting mirror is formed by a fθ-type mirrorwith at least two surfaces and optical axes of both fθ-type mirrors aremade parallel with each other, and includes functions that relay a focuspoint of one of fθ-type mirrors in proximity to the crystal ball of theeyeball by way of a third fisheye-type optical system and relay thefocus point of the other thereof in proximity to the first optoelectricelement by way of the second fisheye-type optical system.

A ninety-fourth invention for achieving the above object is the imagedisplay device set forth in any of the eighty-eighth throughninety-first inventions that further includes a deflecting mirrorbetween the first fisheye-type optical system and the retina of theeyeball, wherein the deflecting mirror is formed by an elliptic mirrorwith at least two surfaces and one of two focus points of the twoelliptic mirrors is arranged substantially at the same position as thatof the other thereof and all focus points are arranged substantially ina straight line.

A ninety-fifth invention for achieving the above object is the imagedisplay device set forth in any of the eighty-eighth throughninety-fourth inventions, wherein the control device includes at leastany of a focus adjustment device to focus on the predetermined wideimage or a device that controls an output scope of a wide image at will.

A ninety-sixth invention for achieving the above object is the imagedisplay device set forth in any of the eighty-eighth throughninety-fifth inventions, wherein the control device includes an imagecomposite device that composites first image information and secondimage information different from the first image information and outputsinformation of a composite image from the first optoelectric element.

A ninety-seventh invention for achieving the above object is the imagedisplay device set forth in any of the eighty-eighth throughninety-fifth inventions, wherein the control device includes functionsthat optically composites first image information output from the firstoptoelectric element and second image information output from the secondoptoelectric element and projects, and forms the composite image on theretina inside the eyeball.

A ninety-eighth invention for achieving the above object is the imagedisplay device set forth in any of the ninety-sixth or ninety-seventhinvention, wherein the control device corrects at least one of the firstimage information and the second image information based uponinformation of distortion produced by the first fisheye-type opticalsystem and then composites the corrected image information.

A ninety-ninth invention for achieving the above object is the imagedisplay device set forth in any of the ninety-fifth throughninety-eighth inventions, wherein at least one of the first imageinformation and the second image information includes information of atleast one of images output from a video, a DVD and a high vision.

A hundredth invention for achieving the above object is the imagedisplay device set forth in any of the ninety-fifth through ninety-ninthinventions, wherein at least one of the first image information and thesecond image information includes image information output from acomputer.

A hundred-first invention for achieving the above object is the imagedisplay device set forth in any of the ninety-fifth through hundredthinventions, wherein at least one of the first image information and thesecond image information includes keyboard information input to acomputer.

A hundred-second invention for achieving the above object is the imagedisplay device set forth in any of the ninety-fifth throughhundred-first inventions, wherein at least one of the first imageinformation and the second image information includes information inputto a portable keyboard attached to a hand.

A hundred-third invention for achieving the above object is the imagedisplay device set forth in the hundred-second invention, wherein theportable keyboard input information includes image information obtainedby detecting information of an electromagnetic element attached to athumb with an electromagnetic detection sensor attached to other fingersand converting the information of the electromagnetic element intoinformation of the distance/direction between the thumb and the otherfingers.

A hundred-fourth invention for achieving the above object is the imagedisplay device set forth in any of the hundred-second or hundred-thirdinvention, wherein the portable keyboard input information includesimage information obtained by detecting information of each finger'spressure against an object with a pressure detection sensor attached toeach finger and converting the information of each finger's pressureinto recognizable information as an image.

A hundred-fifth invention for achieving the above object is the imagedisplay device set forth in any of the hundred-second or hundred-fourthinvention, wherein at least one of the first image information and thesecond image information includes image information made up of text intowhich a voiced or non-voice sound input to a microphone or headphone isconverted.

A hundred-sixth invention for achieving the above object is an imagedisplay device made up of two image display devices set forth in any ofthe eighty-eighth through hundred-fifth inventions, wherein the twoimage display devices are separately arranged to right and left eyeballsrespectively and a space between both image display devices is madeadjustable corresponding to a space between right and left eyeballs suchthat a space between the first fisheye-type optical systems of the twoimage display devices and a space between eyeballs are made equal.

A hundred-seventh invention for achieving the above object is the imagedisplay device set forth in any of the eighty-eighth throughhundred-fifth inventions, wherein the image display device is arrangedto at least one of right and left eyeballs.

A hundred-eighth invention for achieving the above object is an imagedisplay device that includes a control device that controls an imageoutput from the first optoelectric element which is to be formed byprojecting and forms light emitted from a first optoelectric element ofemitting light in a two-dimensional way perpendicular to a direction ofemitted flux on a retinal of an eyeball via the first fisheye-typeoptical system inclusive of a relay optical system, wherein the controldevice includes at least any of a focus adjustment device to focus onthe predetermined wide image or a device that controls an output scopeof the wide image at will and the wide image has an viewing angle with60 degrees and over.

A hundred-ninth invention for achieving the above object is the imagedisplay device set forth in the hundred-eighth invention, wherein thefirst fisheye-type optical system includes a function that supplieslight flux including image data to an image detection area of the retinadue to a movement of the crystal ball corresponding to a turn of aneyeball.

A hundred-tenth invention for achieving the above object is the imagedisplay device set forth in any of the hundred-eighth or hundred-ninthinvention, wherein the first fisheye-type optical system includes atleast one of a hyperboloid lens or a rotationally symmetric lens with atwo-dimensional curved surface.

A hundred-eleventh invention for achieving the above object is the imagedisplay device set forth in the hundred-eighth through hundred-tenthinventions, wherein the relay optical system includes at least one ofthe hyperboloid lens or the rotationally symmetric lens with thetwo-dimensional curved surface.

A hundred-twelfth invention for achieving the above object is the imagedisplay device set forth in the hundred-eleventh invention, wherein thehyperboloid lens or the rotationally symmetric lens with thetwo-dimensional curved surface of the relay optical system is arrangedin proximity to a pupil position.

A hundred-thirteenth invention for achieving the above object is theimage display device set forth in any of the hundred-eighth throughhundred-twelfth inventions, wherein the relay optical system includes atleast one curved surface mirror that corrects telecentricity.

A hundred-fourteenth invention for achieving the above object is theimage display device set forth in any of the hundred-eighth throughhundred-thirteenth inventions, wherein the image display device isarranged to at least one of right and left eyeballs.

A hundred-fifteenth invention for achieving the above object is theimage display device set forth in any of the hundred-eighth throughhundred-fourteenth inventions, wherein the control device includes animage composite device that composites first image information andsecond image information different from the first image information andoutputs information of a composite image from the first optoelectricelement.

A hundred-sixteenth invention for achieving the above object is theimage display device set forth in any of the hundred-seventh throughhundred-fifth inventions, wherein the control device includes functionsthat optically composites first image information output from the firstoptoelectric element and the second image information output from thesecond optoelectric element and projects and forms a composite image onthe retina inside the eyeball.

A hundred-seventeenth invention for achieving the above object is theimage display device set forth in any of the hundred-fifteenth throughhundred-sixteenth inventions, wherein the control device corrects atleast one of the first image information and the second imageinformation based upon information of distortion produced by the firstfisheye-type optical system and then composites the corrected imageinformation.

A hundred-eighteenth invention for achieving the above object is theimage display device set forth in any of the hundred-fifteenth throughhundred-seventeenth inventions, wherein at least one of the first imageinformation and the second image information includes information of atleast one of images output from a video, a DVD and a high vision.

A hundred-nineteenth invention for achieving the above object is theimage display device set forth in any of the hundred-fifteenth throughhundred-eighteenth inventions, wherein at least one of the first imageinformation and the second image information includes image informationoutput from a computer.

A hundred-twentieth invention for achieving the above object is theimage display device set forth in any of the hundred-fifteenth throughhundred-nineteenth inventions, wherein at least one of the first imageinformation and the second image information includes keyboardinformation input to a computer.

A hundred-twenty-first invention for achieving the above object is theimage display device set forth in any of the hundred-fifteenth throughhundred-twentieth inventions, wherein at least one of the first imageinformation and the second image information includes information inputto a portable keyboard attached to a hand.

A hundred-twenty-second invention for achieving the above object is theimage display device set forth in the hundred-twenty-first invention,wherein the portable keyboard input information includes imageinformation obtained by detecting information of an electromagneticelement information attached to a thumb with an electromagneticdetection sensor attached to other fingers and converting theinformation of the electromagnetic element into information of adistance/direction between the thumb and the other fingers.

A hundred-twenty-third invention for achieving the above object is theimage display device set forth in any of the hundred-twentieth orhundred-twenty-first invention, wherein the portable keyboard inputinformation includes image information obtained by detecting informationof each finger's pressure against an object with a pressure detectionsensor attached to each finger and converting the information of eachfinger pressure into recognizable information as an image.

A hundred-twenty-fourth invention for achieving the above object is theimage display device set forth in any of the hundred-fifteenth throughhundred-twenty-third inventions, wherein at least one of the first imageinformation and the second image information includes image informationmade up of text into which a voice sound or a non-voice sound input to amicrophone or headphone is converted.

A hundred-twenty-fifth invention for achieving the above object is animage display device made up of two image display devices set forth inany of the hundred-fifteenth through hundred-twenty-fourth inventions,wherein the two image display devices are separately arranged to rightand left eyeballs respectively and a space between both image displaydevice is made adjustable corresponding to a space between right andleft eyeballs such that a space between the first fisheye-type opticalsystems of the two image display devices and a spacing between eyeballsare made equal.

A hundred-twenty-sixth invention for achieving the above object is theimage display device made up of one image display device set forth inany of the hundred-fifteenth through hundred-twenty-fourth inventions,wherein the single image display device is divided to right and lefteyeballs respectively by an optical member and a space between projectedimages of each of the first optical fisheye-type optical system is madeadjustable corresponding to a space between a right eye and a left eyesuch that a space between the first fisheye-type optical systemsseparately arranged to split light flux and a space between eyes aremade equal.

A hundred-twenty-seventh invention for achieving the above object is theimage display device set forth in any of the hundred-eighth throughhundred-twenty-sixth inventions that further includes a light diffusionmember that is arranged on an image-formed surface arranged on anoptical path of an optoelectric member of outputting the image data anda crystal ball and that diffuses light, wherein at least a part of thefirst fisheye-type optical system lets diffused transmitting lightconverge in proximity to a crystal ball and an image of a subject beformed on a retina.

A hundred-twenty-eighth invention for achieving the above object is theimage display device set forth in the hundred-twenty-seventh invention,wherein the light diffusion member of diffusing the light is atransparent diffusion substrate that is coated on a transparentsubstrate with a particle of a metal oxide or a metallic carbide of aparticle diameter controlled by an order of a micron.

A hundred-twenty-ninth invention for achieving the above object is theimage display device set forth in the hundred-twenty-eighth invention,wherein the particle is at least one of silicon carbide, chromic oxide,tin oxide, titanium oxide, magnesium oxide and aluminum oxide and thetransparent diffusion substrate is a polyester film.

A hundred-thirtieth invention for achieving the above object is theimage display device set forth in any of the fortieth throughhundred-twenty-ninth inventions, wherein at least a part of the imagedisplay device is supported by a member rather than the user and isplaced at a contact with the user's face, and is made movable inresponse to a movement of the user's face.

A hundred-thirty-first invention for achieving the above object is theimage display device set forth in the hundred-thirtieth invention,wherein at least a part of the image display device is made capable ofmoving toward any of directions of six axes.

A hundred-thirty-second invention for achieving the above object is theimage display device set forth in the hundred-thirty-first invention,wherein the image display device is supported at a position of centre ofgravity of the image display device or in proximity to its positioncapable of moving toward directions of six axes at will.

A hundred-thirty-third invention for achieving the above object is theimage display device set forth in the hundred-thirty-first orhundred-thirty-second invention that further includes a weight memberthat balances the body of the image display device, a flexible stringmember that links the body of the image display device and the weightmember, and a pulley in order to enable the image display device to movetoward directions of six axes at will.

A hundred-thirty-fourth invention for achieving the above object is theimage display device set forth in any of the hundred-eighth throughhundred-thirty-third inventions, wherein a unit controlling an outputarea of the wide image at will is an optical zoom device of a variablemagnification of 2× and over and controls such that a composite imagecomposited by the first image information and the second imageinformation does not overlap over a predetermined width corresponding toa state of a zoom.

A hundred-thirty-fifth invention for achieving the above object is theimage display device set forth in the hundred-eighth throughhundred-thirty-fourth inventions, wherein the unit controlling theoutput area of the wide image at will includes a detection member thatdetects an moving image of a landscape flowing on an observer's line ofvision and a storage member that processes the image such that the imagedoes not move during a predetermined period of time and stores theprocessed image.

A hundred-thirty-sixth invention for achieving the above object is theimage display device set forth in the hundred-eighth throughhundred-thirty-fifth inventions, wherein the unit controlling an outputarea of the wide image at will includes a selection member that freelyselects use or non-use of the detection member and processing/storagemember at will.

A hundred-thirty-seventh invention for achieving the above object is theimage display device set forth in the hundred-thirty-fifth orhundred-thirty-sixth invention, wherein the detection member and thestorage member take image data into an internal buffer and divide animage output from the internal buffer into a marginal image block and acenter image block and computes an amount in a lateral shift within ablock for a predetermined period of time and judges whether the shift isattributed to a hand shake or a lateral movement of a screen when themarginal image and center image are shifted in the same direction, andprocess the image in such a way that makes an overall screen look stillby shifting an overall image bit by the same amount as a movement amountin a direction opposite a direction of an image movement such that theimage does not move laterally for the predetermined period of time.

A hundred-thirty-eighth invention for achieving the above object is animage display device made up of two image display devices set forth inany of the hundred-fifteenth through hundred-twenty-fourth inventions,wherein these two image display devices include an imagesplitting/composite device that supplies an image to right and lefteyeballs respectively by splitting and compositing the image, and aswitching device that switches over the image splitting/composite deviceof supplying the image separately to right and left eyeballsrespectively.

A hundred-thirty-ninth invention for achieving the above object is theimage display device set forth in any of the hundred-thirtieth throughhundred-thirty-fifth inventions, wherein a part of the image displaydevice includes at least one of an earthquake detecting sensor, a levelmeasuring/adjustment device and a fixed device.

A hundred-fortieth invention for achieving the above object is the imagedisplay device set forth in any of the hundred-thirtieth throughhundred-thirty-third inventions or the hundred-thirty-ninth invention,wherein a part of the image display device includes at least one of atimer device and a movement device that moves an image display sectionin accordance with an output of the timer device.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a schematic view showing a first embodiment of this invention.

FIG. 2 is a schematic view showing a second embodiment of thisinvention.

FIG. 3 is a view showing a principle of a third embodiment of thisinvention.

FIG. 4 is a schematic view showing a third embodiment of this invention.

FIG. 5 is a view showing a range of image information that can be seenwhen an eyeball turns.

FIG. 6 is a schematic view showing a principle of a fourth embodiment ofthis invention.

FIG. 7 is a schematic view showing a fifth embodiment of this invention.

FIG. 8 is a schematic view showing a sixth embodiment of this invention.

FIG. 9 is a schematic view showing a seventh embodiment of thisinvention.

FIG. 10 is an explanatory view when converting image input informationof the seventh embodiment into image output information, wherein (a)shows an image of receiving light, (b) output image of liquid crystaltype two-dimensional output device 6 of 24L and (c) output image ofliquid crystal type two-dimensional output device 6 of 24R.

FIG. 11 is a schematic view showing an eighth embodiment of thisinvention.

FIG. 12 is an explanatory view when correcting distortion of externalinput image information for compositing an image.

FIG. 13 is a schematic view showing a ninth embodiment of thisinvention.

FIG. 14 is an explanatory view when correcting distortion of a pluralityof external input image information for compositing an image.

FIG. 15 is a view showing a tenth embodiment of this invention, whereina device to input image information is detachable from a device tooutput image information and interchangeable.

FIG. 16 is a conceptual view of two examples in a conventional art.

FIG. 17 is a view showing a position where parallel light flux enteringfrom three different directions converges at crystal ball A within anfisheye optical system.

FIG. 18 is a view showing a configuration that alleviates asymmetry ofan image plane by inserting a correction optical system in proximity toa position of a common focus point of two elliptic mirrors.

FIG. 19 is a view showing how to make a viewing angle small by disposinga reverse fisheye lens unit in an eyeball.

FIG. 20 is a view showing a configuration using a fθ mirror to relaylight leaving from an eyeball up to a liquid crystal-typetwo-dimensional output device of a predetermined size.

FIG. 21 is a view showing that the device shown in FIG. 20 is arrangedseparately to right and left eyeballs respectively.

FIG. 22 is a view showing an example where curvature of field iscorrected by way of a curved surface mirror.

FIG. 23 is a view showing one example of an embodiment of a displaydevice.

FIG. 24 is a view showing a schematic configuration of an image pick-updevice, wherein an arrow indicates a direction of view.

FIG. 25 is a view showing a position of a focus point and a direction ofsight lines of both eyes in the right and left image display device whenforming an image a far away and at a close distance.

FIG. 26 is a view showing an example in more detail about a case wherean image is optically composited with a half mirror. Ninety-first (91)is an output image of VGA liquid crystal element for field of view of aleft eye, ninety-second (92) an output image of VGA liquid crystalelement for field of view of a left eye and ninety-third (93) acomposite image that can be viewed by a retina of field of view of theleft eye.

FIG. 27 is a view showing a compositing image when adjusting a zoomunit. (a) shows a case for a movie viewing purpose, (b) for a wholefile-of-view observation and an arrow indicates that the zoom unitchanges a mode from the movie viewing to the whole file-of-viewobservation.

FIG. 28 is a view showing an example of a display device wherein anautomatic focus control device is arranged in a fisheye-type opticalsystem including an eyepiece lens.

FIG. 29 is a view showing an example of an image pick-up device whereinan automatic focus control device is arranged in a fisheye-type opticalsystem including an eyepiece lens.

FIG. 30 is a view showing an example of a fixed-type image pick-updevice for use in a security and disaster precaution and wild animalwatching etc.

FIG. 31 is a view showing an overall configuration of a floor-standingimage display device.

FIG. 32 is a view showing a case where a display device of a wholeviewing angle is used when lying on the back.

FIG. 33 is a view showing an overview of a configuration of the displaydevice of a whole viewing angle that fits a face by absorption.

FIG. 34 is a plane view looking at the display device of a whole viewingangle from an upper position.

FIG. 35 is a schematic view of a fisheye-type optical system includingthe eyepiece lens in the embodiment of this invention and a view showinglight flux of ±70 degrees when the crystal ball moves 20 mm, consideringa quick movement of a human-being eye.

FIG. 36 is a schematic view of a fisheye-type optical system includingthe eyepiece lens in the embodiment of this invention and a view showinga case where a size of an eye pupil is set at an order of 3 mmequivalent to a typical size thereof indoors.

FIG. 37 is a schematic view of a fisheye-type optical system includingthe eyepiece lens in the embodiment of this invention and a view showinglight flux in a case where defocused curvature of field is intentionallyintroduced corresponding to a viewing angle from a center of a viewing.

FIG. 38 is a schematic view of a fisheye-type optical system includingthe eyepiece lens in the embodiment of this invention and a view showinglight flux in a case where a focus position does not vary that much evenwith a quick eyeball movement.

FIG. 39 is a schematic view of a fisheye-type optical system includingthe eyepiece lens in the embodiment of this invention and a view showinglight flux in a case where an eye views an object at 50 cm ahead.

FIG. 40 is a view showing an example where the display device of a wholeviewing angle is supported by way of a magic hand technology.

FIG. 41 is a view showing an example where a weight of the displaydevice of a whole viewing angle is cancelled out by way of a counterweight.

FIG. 42 is a view showing an example where the whole viewing angledisplay device is made freely movable by way of a universal joint.

FIG. 43 is a view showing an example where curvature of field on asurface of forming an image and a tilt of telecentricity are made smallby way of a hyperboloid lens. (a) indicates a case where there is nolateral shift of an eyeball (quick eyeball movement), (b) there is thelateral shift of an eyeball with 30 degrees (quick eyeball movement) andan arrow represents an output of a picture image.

FIG. 44 is a view showing light flux for each angle of view of anoptical system shown in FIG. 43.

FIG. 45 is a view showing aberrations corresponding to characteristicsshown in FIG. 44. (a), (b) and (c) represent spherical aberration,astigmatism and distortion from a left side.

FIG. 46 is a view showing an example of an optical system that relayslight flux from an output surface of LCD to a diffusion glass. (b) showsaberrations in which spherical aberration, astigmatism and distortionare shown from a left side.

FIG. 47 is a view showing an example of an optical system that relayslight flux from an output surface of LCD to a diffusion glass. (b) showsaberrations in which spherical aberration, astigmatism and distortionare shown from a left side.

FIG. 48 is a schematic view of a device of an embodiment of thisinvention using an optical system shown in FIGS. 44 (a) and 47.

FIG. 49 is a view showing a comparison table of a conventional productvs. a product of this invention.

FIG. 50 is a view showing a sate where the display device of a wholeviewing angle is supported by accommodating the weight into a supportingmember.

FIG. 51 is a view showing a sate where the display device of a wholeviewing angle is supported by accommodating the weight into a supportingmember.

FIG. 52 is a schematic view showing one of examples in an embodiment ofthis invention.

BEST MODE FOR CARRYING OUT THE INVENTION

An example of a preferred embodiment of this invention will be describedhereunder referring to accompanying diagrams. FIG. 1 is a schematicdiagram showing a first embodiment of this invention, wherein FIG. 1 isa cross-sectioned view taking a top view of a head of a user and shows aleft side of a head, wherein contour 3 of a face, left eyeball 1L andnose 4 beside left eye crystalline lens 2L are depicted at a lower rightthereof. An upper area of the figure has a broad field of view and awide image from a broad field of view is formed on CCD two-dimensionalarray sensor 9 with first fisheye-type optical system 10. In this case,first fisheye-type optical system 10 has a wide angle of view andconverts light flux from an object in the field of view into thin lightflux, and then forms an image of the object on CCD two-dimensional arraysensor 9.

A fisheye-type optical system referred to in the specifications andclaims means an optical system in general that can produce a wider angleof view than a range of field of view with which a user can clearlygrasp a color and its detail of an object and includes not only aso-called fisheye lens (has an angle of view of 180 degrees against adiagonal line of a screen) but also a wide-angle lens (covers diagonally60 to 90 degrees) and an ultra wide-angle lens (covers diagonally 90degrees and over), and a standard lens with an angle of view of 30degrees and over. As a preferred embodiment of this invention, a lenswith an angle of view of 90 degrees and over against a diagonal line isdesirable.

In other words, the fisheye-type optical system set forth in thespecifications and claims means an optical system capable of gettingwide field-of-view information in a broad sense against a generalprojection optical system and includes a special optical system etc withastigmatism including an aspherical lens, a cylindrical lens etc, not tomention a typical wide-angle lens and a fisheye lens. Furthermore,elliptical mirror includes a special elliptical mirror that hasastigmatism of a different curvature in a lateral line and verticallines and a mirror elliptical toward only a direction of one axis etcand thus, an explanation in the specifications and claims will be givenon the assumption of the foregoing.

An image formed on CCD two-dimensional array sensor 9 is output toliquid crystal display-type two-dimensional output device 6 as outputimage information by image processing device 8. Liquid crystal typetwo-dimensional output device 6 is illuminated by a backlight, whereinlight is emitted from a pixel equivalent to an image corresponding tothe output image information. This light, as light flux to diverge againat a large angle by second fisheye-type optical system 7, diverges froma virtual focal point. This diverging light flux is deflected withthree-dimensional elliptical mirror 5, but an optical system is arrangedsuch that the virtual focal point is positioned in proximity to a firstfocal point of three-dimensional elliptical mirror 5, so the diverginglight flux converges in proximity to a second focal point ofthree-dimensional elliptical mirror 5.

There is left-eye crystalline lens 2L of left eyeball 1L in proximity tothe second focal point and as a result, a wide image is formed on aretina of left eyeball 1L as a projection image. The reason why left-eyecrystalline lens 2L is positioned in proximity to the second focal pointis that a pupil position of an optical system is made approximately inalignment with a pupil position of an eyeball and vignetting is reduced.

Namely, an image pattern formed on a surface of liquid crystaldisplay-type two-dimensional output device 6 is formed on a retina as animage extending over an effective whole field area of a retina or anarea nearly equal to the effective whole field area of the retina.Accordingly, an image of a viewing angle covering the effective wholefield area of the retina or the area nearly equal to the effective wholefield area of the retina can be formed.

Also, as seen from FIG. 1, a surface passing through a middle point of aline linking both focal points of three-dimensional elliptical mirror 5and being orthogonal to the line is configured to intersect a reflectionsurface of three-dimensional elliptical mirror 5. The above-describedarrangement makes it possible to get a broad reflection surface ofthree-dimensional elliptical mirror 5 and to reflect all light dispersedand emitted from CCD two-dimensional array sensor 9 or most thereof, andthereby to cause the light to converge in proximity to the second focalpoint.

By the way, a word “proximity” set forth in the description of “thevirtual focal point is positioned in proximity to a first focal point ofthree-dimensional elliptical mirror 5” and “There is left eyecrystalline lens 2L of left eyeball 1L in proximity to the second focalpoint” means as follows. When the image display device has an viewingangle of 60 degrees and over, if an extent of a loss by the vignettingis not any problem substantially, it is not necessary that the virtualfocal point and left eye crystalline lens 2L be exactly positioned at afocal point and although a position relationship between the secondfocal point and the crystalline lens deviates with attachment of theimage display device, this order of a deviation is tolerable.

In the specifications and claims of this invention, it should be notedthat the word “in proximity to the focal point” is used with such themeaning unless otherwise described.

In FIG. 1, to make two focal points of three-dimensional ellipticalmirror 5 clearly understood, a part of an ellipse that in fact does notexist is depicted with a broken line. In diagrams below, such thedepiction will be adopted when referring to a reflection mirror.

In the preferred embodiment as shown in FIG. 1, as seen from light flux,an angle of the light flux inside left eyeball 1L is different from theone of corresponding light flux of second fisheye type optical system 7.That is, large distortion occurs. Taking this distortion into account,image processing device 8 performs a digitized correction on an imageoutput from liquid crystal two-dimensional output device 6 in responseto input information of CCD two-dimensional array sensor 9 and thereby afaithful image can be projected onto a retina inside left eyeball 1L.

But, a typical CCD two-dimensional array sensor and a liquid crystaltwo-dimensional output device are aggregation of a limited lightreceiving element and liquid crystal element and if the digitizedcorrection is made, a part of the compressed distortion has informationforcibly expanded, so resolving power falls off and a faithful imagecannot be obtained.

A schematic view of a second preferred embodiment of this invention toavoid such the shortcoming is shown in FIG. 2. In diagrams below, thesame components as in FIG. 1 denote the same references, but theirexplanations are omitted in some case. As a matter of explanatoryconvenience, there are some that the same component uses a differentreference. Also, to show “for a left eye”, “L” is affixed at the end ofnumeral and other text and for a right eye, “R” is affixed in the sameway, and in the event that a thing is the same and it is common in botheyes, there is a case where the thing is described without L and R.

This embodiment does not put second fisheye-type optical system 7 intothe first focal point of three-dimensional elliptical mirror 5 directly,but a virtual dispersing light source is provided at this focal part.With first fisheye-type optical system 10, a wide image from a widefield of view is compressed and a projection image is formed on CCDtwo-dimensional array sensor 9. In this case, first fisheye-type opticalsystem 10 has a wide-angle field of view and converts light flux from anobject in the field of view into thin light flux and thereby has animage of the object formed on CCD two-dimensional array sensor 9.

The image formed on CCD two-dimensional array sensor 9 is output toliquid crystal two-dimensional output device 6 by image processingdevice 8. Liquid crystal two-dimensional output device 6 is illuminatedby a backlight and light is emitted from a pixel equivalent to an imagein correspondence to output image information. This light is madeparallel light flux via distortion correcting optical system 13including fθ lens and is reflected by fθ mirror 12, and thereby becomeslight flux passing through its focal point. A position of the focalpoint of the fθ mirror is so placed as to be in alignment with aposition of the second focal point of three-dimensional ellipticalmirror 5.

Consequently, light emitted from liquid crystal two-dimensional outputdevice 6 becomes dispersing light from a focal point of fθ mirror 12,that is, the second focal point of three-dimensional elliptical mirror5, and the dispersing light is reflected at a wide angle of dispersionby three-dimensional elliptical mirror 5, and converges in proximity toa position of left-eye crystalline lens 2L of left eyeball 1L arrangedin proximity to the first focal point and thereby an image is formed onleft eyeball 1L at a wide angle. Thus, an eyeball receives the lightflux from liquid crystal two-dimensional output device 6, so the eyeballreceives information output from CCD two-dimensional array sensor 9.Distortion correcting optical system 13 is an optical system that has afunction to correct such the distortion produced by three-dimensionalelliptical mirror 5.

In this case, although the distortion produced by three-dimensionalelliptical mirror 5 is corrected by distortion correcting optical system13, it is quite difficult for only distortion correcting optical system13 to correct distortion produced by first fisheye-type optical system10 and thus, with image processing device 8, a faithful image getsobtained by a digitized distortion correction.

A “fθ mirror” referred to in the specifications and claims is a mirrorin a broad sense in that light flux emitted from a light source is madeparallel light flux and is used herein as a generic name of a mirrorwith such the effect.

FIG. 3 shows a principle of a third preferred embodiment of thisinvention. In FIG. 3, the fθ mirrors are configured to face one anotherin place of first three-dimensional elliptical mirror 5 shown in FIG. 2and two focal points are created using first fθ mirror 15 and second fθmirror 14. When a first focal point (a focal point of first fθ mirror15) is arranged in proximity to crystalline lens 2′ of virtual eyeball1′ and a second focal point (a focal point of second fθ mirror 14) isarranged in proximity to left-eye crystalline lens 2L of left eyeball1L, it can be seen that internal light flux of virtual eyeball 1′ andleft eyeball 1L becomes the same light flux reversed in axis symmetrywith respect to Y-axis (an axis that lies at right angles to a linelinking focal points of two fθ mirrors and passes through a midpoint ofthese two focal points). In FIG. 3, optical axes of first fθ mirror 15and second fθ mirror 14 are made in alignment with each other, but it issufficient to make these axes parallel and thus alignment is notnecessarily required.

A schematic overview of a third embodiment of this invention applyingthis principle is shown in FIG. 4, wherein there is a wide view area inan upper part of FIG. 4 and with first fisheye-type optical system 10, awide image from a wide view is compressed and a projection image isformed on CCD two-dimensional array sensor 9. In this case, firstfisheye-type optical system 10 has a wide-angle field of view andconverts light flux from an object in the field of view into thin lightflux, and thereby an image of the object is formed on CCDtwo-dimensional array sensor 9.

The image formed on CCD two-dimensional array sensor 9 is output toliquid crystal two-dimensional output device 6 as output imageinformation by image processing device 8. Liquid crystal two-dimensionaloutput device 6 is illuminated by a backlight and light is emitted froma pixel equivalent to the image in correspondence to the output imageinformation. This light is dispersed as light flux to be dispersed againat a large angle with second fisheye-type optical system 7. Thus, secondfisheye-type optical system 7 is arranged such that a virtual focalpoint of this second fisheye-type optical system 7, that is, a point ofemitting light, matches a position of a focal point of first fθ mirror15.

Consequently, light emitted from second fisheye-type optical system 7 isreflected in a broad range of first fθ mirror 15 and thereby becomesparallel light flux, and then the parallel light flux enters second fθmirror 14. As optical axes of first fθ mirror 15 and second fθ mirror 14are in alignment with one another, this incident light converges at afocal point of second fθ mirror 14. Left-eye crystalline lens 2L of lefteyeball 1L lies in proximity to this focal point, so the converged lightpasses through a crystalline lens and then a reversed image with thesame broadening as the virtual focal point is formed on a retina of lefteyeball 1L. Therefore, a faithful image can be obtained at the sameangle as an effective viewing angle or a wide angle close to thiseffective angle. This arrangement produces only distortion due to amanufacturing and attachment errors and an image hardly getsdeteriorated thanks to a digitized correction. It is ideal that opticalaxes of first fθ mirror 15 and second fθ mirror 14 are made in alignmentwith one another, but the same effect can be obtained as far as they areparallel.

However, in this third embodiment, as shown in FIG. 4, second fθ mirror14 is not allowed to extend over so much to a left side of FIG. 4, sothere is a limit to field of view capable of receiving light in adirection opposite to nose 4, and also when a movement of eyeball 1 isput into consideration, it is turned out that a part of a wide imageseen by a user gets vignetted.

This is illustrated in FIG. 5. FIG. 5 (a) illustrates a case where themovement of eyeball 1 is not taken into consideration and it is enoughto consider only field of view of a range indicated by reference numeral22. Not only light flux 12 entering from a front side but also lightflux 11 and 13 entering from an oblique direction fully cover a range ofcrystalline lens 2. But, when the movement of eyeball 1 is taken intoconsideration, the range of field of view broadens out to a rangeindicated by reference numeral 22 of FIG. 5 (b). FIG. 5 (b) is a viewshowing that an eyeball turns clockwise and in this case, there is nolight flux entering from a direction indicated by a therein in the fieldof view, so it is turned out that this part becomes blind and thereby, apart of field of view is lacked.

A principle of a fourth embodiment to solve such the problem is shown inFIG. 6. In FIG. 6, to show the most ideal example, with lens 21 andspherical surface-type CCD light receiving sensor 20 that artificiallyduplicate an eyeball structure of a human being, a wide image isreceived by a CCD element inside the spherical surface as it is. As anoutput from image processing device 8, information output from sphericalsurface-type CCD light receiving sensor 20 emits a liquid crystal imageintact as diffusing light flux from spherical surface-type liquidcrystal device 19 that artificially duplicates the eyeball structure ofthe human being via lens 18 of the same performance as lens 21.

Light flux entering lens 21 is duplicated as the light flux that has thecompletely same optical path as one of light flux emitted from lens 18.When this diffusing light flux can be precisely duplicated on left-eyecrystalline lens 2L of left eyeball 1L, information of a wide area fieldof view entering lens 21 turns out to become exactly equivalent to imageinformation entering within left-eye crystalline lens 2L, and thereby itis turned out that almost no distortion is produced. To realize this,the fourth embodiment uses two elliptical mirrors 17 and 16.

Namely, a first focal point of first elliptical mirror 17 is arranged inproximity to lens 18 and a second focal point of first elliptical mirror17 is configured to be in alignment with a first focal point of secondelliptical mirror 16 and further a second focal point of secondelliptical mirror 16 is arranged in proximity to left-eye crystallinelens 2L. Then, the focal points of these elliptical mirrors are arrangedin a straight line and a flat surface passing through a centre of a linelinking the first and second focal points of first elliptical mirror 17and being orthogonal to this line and a reflection surface that deflectslight flux of first elliptical mirror 17 are configured to intersect.

As a result, light flux within left eyeball section 1L and light fluxwithin spherical surface-type liquid crystal device 19 becomesequivalent to each other, so the diffusing light flux emitted from lens18 can be precisely duplicated on left-eye crystalline lens 2L of lefteyeball 1L. It is not necessary that such conditions be filledcompletely, but distortion and other aberrations get deteriorated by anamount of non-filled conditions. So, when optimum conditions are notfilled owing to a designing restriction etc, it is desirable that adigitized distortion correction be performed. Herein, an ellipticalmirror is used and more particularly, an elliptical mirror that has abroad reflection surface such that a flat surface passing through thecentre of the line linking the first and second focal points of firstelliptical mirror 17 and being orthogonal to this line and a reflectionsurface to deflect light flux of first elliptical mirror 17 intersect isused.

This arrangement makes it possible to input information from a wide areafield of view into left-eye crystalline lens 2L. Thus, the informationfrom the wide area field of view entering lens 21 can be duplicated inthe end as it is on a retina of left eyeball 1L via left-eye crystallinelens 2L and a faithful image can be obtained across a broad viewingangle. And as seen from a comparison of FIGS. 4 and 6, in a case of FIG.6, a necessary viewing angle can be obtained even if left eyeball 1Lturns and moves since a sufficient broad field of view can be secured ona left side of left eyeball 1L.

However, it is difficult to design spherical surface-type CCD lightsensor 20 and spherical surface-type liquid crystal device 19 and it isexpected that a manufacturing cost will be greatly increased. Therefore,as a modification example of the first through third embodiments of thisinvention, a fifth embodiment of this invention is proposed and itsoverview is shown in FIG. 7. This embodiment adopts fisheye-type opticalsystems 10 and 7 of almost the same characteristics, and also CCDtwo-dimensional array sensor 9 and liquid crystal two-dimensional outputdevice 6 of almost the same characteristics such as an effective fieldof view etc. Even when there is a difference in the effective field ofview, it is possible to adjust by differentiating projectionmagnifications of fisheye-type optical systems 10 and 7, but it isdesirable that distortion characteristics be met as much as possible.

Namely, a retina of a human's eyeball has high sensitivity and resolvingpower at its centre thereof, but the sensitivity and resolving power arelow at an edge thereof. Thus, if only a shape and movement of a thingcan be observed at the edge thereof, this observed information workswell as information sufficient to perceive. Therefore, by way of firstfisheye-type optical system 10, a wide area field of view informationdue to characteristics that exaggerate information at its centre andcompress information at its edge is projected on CCD two-dimensionalarray sensor 9 with a flat surface and is stored and this information isemitted from liquid crystal-type two-dimensional output device 6 with aflat surface and is restored again by second fisheye-type optical system7 of the same characteristics as first fisheye-type optical system 10,and then image information is sent to crystalline lens 2L via first andsecond elliptical mirrors 17 and 16. This arrangement makes it possibleto faithfully form wide area field-of-view information without lack ofdata at the central portion and with small distortion on a retina insideleft eyeball 1L.

As a fisheye lens herein, it is most effective to employ a nonlinearfisheye lens of which a deformation of distortion is small within 60degrees of an viewing angle, which is the highest frequency of usage ina human being's eye, and that compresses an image lying at an order ofan angle of right/left 30 degrees around the 60-degree area. An eye'seffective viewing angle in upwards/downwards directions is smaller thanthat of a lateral direction. And thus, when a short side of a rectangleis set in a longitudinal direction and a long side thereof is set in alateral direction as a way of arranging CCD two-dimensional array sensor9 and liquid crystal two-dimensional output device 6, it is good to beable to obtain a high resolving power.

An image display device for both eyes will be described hereunder withan example of an application that modifies the fifth embodiment as shownin FIG. 8, but it is obviously needless to explain that thismodification can also apply to the preferred first through fourthembodiments.

FIG. 8 is a schematic view showing a sixth embodiment of this inventionof a binoculars-type image display device wherein the image displaydevice of the fifth embodiment is provided for not only left eyeball 1Lbut also right eyeball 2L. An image display device for left eyeball 1Lis denoted by reference numeral 23L and the same for right eyeball 1R isdone by reference numeral 23R. It is a matter of course that there is adifference in spacing between both eyeballs in a human being and whenthis spacing difference cannot be corrected, viewing gets deterioratedand we feel uncomfortable. In this embodiment, an internal component iscompletely independent, so image display device cover 25 is configuredsuch that spacing between image display devices 23L and 23R is madeprecisely adjustable as shown by an arrow corresponding to spacingbetween both eyeballs set at a boundary of a centre.

Also, in this configuration, a light receiving section of wide areafield-of-view is arranged such that spacing between first fisheye-typeoptical systems 10 is made equal to spacing between centers of botheyeballs. Namely, when image information is independently provided fromimage display device 23L to left eyeball 1L and also is provided fromimage display device 23R to right eyeball 1R independently, thisinformation that is obtained by a human being is perceived asthree-dimensional information. Then, if first fisheye-type opticalsystems 10 and CCD two-dimensional array sensors 9 of both image displaydevices 23L and 23R are adjusted in a separating direction, a 3-D effectof an image is increased and its effect becomes high when the increasedeffect is used in a video game etc. Like this, the spacing is configuredto be adjustable depending upon usage. When first fisheye-type opticalsystem 10 or CCD two-dimensional array sensor 9 interferes with secondelliptical mirror 16, a position of arranging first fisheye-type opticalsystem 10 or CCD two-dimensional array sensor 9 may be above or belowsecond elliptical mirror 16 or be removed as needed. Image displaydevice cover 25 is so designed as to be removable.

The sixth preferred embodiment as shown in FIG. 8 is a device that canprovide a three-dimensional image, but when the device is used forviewing still information like news papers, magazines etc as imageinformation, there is no need for a three-dimensional image. In thiscase, as FIG. 9 shows as a seventh preferred embodiment of thisinvention, first fisheye-type optical system 10 and CCD two-dimensionalarray sensor 9 may be doubled as image display devices 24L and 24R. Thisarrangement makes the device compact and affordable. But, in this case,as shown in FIG. 10, it is necessary that different information beprovided to image display devices 24L and 24R as image information thatputs offset corresponding to spacing between both eyeballs and adistance to an object into image information received by CCDtwo-dimensional array sensor 9.

Namely, even if an image captured by CCD two-dimensional array sensor 9looks like (a), an image of image display device 24L for a left eye isshifted toward a left side and a point of meeting at a position of lefteyeball 1L becomes a centre and thereby, a field of view at a right sidegets lacked. Contrary to this, an image of image display device 24R fora right eye is shifted toward a right side and a point of meeting at aposition of right eyeball 1R becomes a centre and thereby, a field ofview at a left side gets lacked. With this arrangement, an image can beclearly reproduced if a focus control corresponding to a distance to theobject is performed at the same time even when the object observed withCCD two-dimensional array sensor 9 is at a near side and an illusionthat the object is far away can be given to an observer, and thisarrangement is useful for preventing eye fatigue.

A schematic overview of an eighth preferred embodiment of this inventionis shown in FIG. 11. This embodiment is an application of the seventhembodiment, wherein digital video unit 28 of only an image sensorelement is capable of being fixed into image display device cover 26.This device is configured such that a shooting target is followed withonly a movement of a head and body while operating zoom switch 29 byleft hand 30 and image information control device 27 composites widearea information obtained from first fisheye-type optical system 10 andCCD two-dimensional array sensor 9 and external information from digitalvideo unit 28 and then the composite information is provided to imagedisplay devices 24L and 24R.

Both of this composite information are stored in image informationcontrol device 27 as image information, so the information can bereviewed as video data by changing an image size and a compositing wayafterwards. Furthermore, this digital video unit 28 can be detached fromimage display device cover 26 as needed, too.

FIG. 12 shows a way of compositing an image in image information controldevice 27. As described before, a projection image of pattern 200, asshown in (a) of FIG. 12, projected by first fisheye-type optical system10 and received on CCD two-dimensional array sensor 9 becomes pattern200, as shown in (c) thereof, of which an edge area is compressed. Onthe other hand, as shown in (b) thereof, as external information 201input from digital video unit 28 does not have such distortion, andthus, in the event that external information 201 is overly output byimage display device 24, it is necessary that an image be compositedafter information is corrected beforehand to information includingdeformation at the edge areas of first fisheye-type optical system 10(in this case, original image of external information 201 is correctedto a pin cushion-type image as shown in (c)) and the composite image beoutput from liquid crystal two-dimensional output device 6.

With this arrangement, a distortion-free faithful image just like (d) ofFIG. 12 can be obtained in the end due to distortion of secondfisheye-type optical system 7. Herein, to make distortion shownunderstand ably, distortion is shown with four sides bowed outwards inFIG. 12, but with a real fisheye lens, a square object becomes a shapelike a barrel. Various shapes can be available depending uponcharacteristics of fisheye lenses.

FIG. 13 shows a schematic overview of a ninth preferred embodiment ofthis invention, wherein image display device 23L of the fifth embodimentis used for a single eye and control device 31 with capabilities of apersonal computer is connected to image display device 23L andfurthermore, portable keyboards 33L and 33R are attached to eachfingertip of left palm 32L and right palm 32R and FIG. 14 shows a way ofcompositing an image in this case.

At each fingertip of portable keyboards 33L and 33R of FIG. 13, thereare provided a sensor and a finger pressure sensor that detect adirection and position from a thumb and each movement of each fingertipis configured so as to be output as image information of a relativeposition relative to the thumb.

In FIG. 14, it is necessary that pattern 205 displaying inputinformation of a keyboard (shown in (d)) be composited and a compositeimage be displayed within the same field of view along with pattern 200(shown in (b)) projected by first fisheye-type optical system 10 andreceived by CCD two-dimensional array sensor 9 like display pattern 203(as shown in (c)) requiring high resolving power output from a computerand tool bar 204 (shown in (a)) displayed on an edge area of a computerscreen.

As described before, the image output from liquid crystaltwo-dimensional output device 6 includes information of distortionproduced by the first fisheye-type optical system and image informationis compressed on an edge area shown in FIG. 14 (e). Then, tool bar 204and keyboard input display pattern 205 that are image information froman external are converted into image information such that distortion ofsecond fisheye-type optical system 7 is reversely corrected and thenconverted image information is composited. As result of this, thecomposite image information is restored as a distortion-free projectionimage like an image of (f) on a retina of an eyeball due to distortionof second fisheye-type optical system 7, so faithful image informationis provided. And, a distortion correction is not performed on displaypattern 203 that requires high resolving power of a computer. The reasonis that display pattern 203 is positioned at a centre of field of viewin FIG. 14 and thus there is no need for considering an effect ofdistortion.

FIG. 15 is an explanatory view explaining a tenth preferredinterchangeable embodiment, wherein an image information input deviceincluding first fisheye-type optical system 10 and CCD two-dimensionalarray sensor 9 is detachable from an image information output devicesuch as liquid crystal two-dimensional output device 6 and secondfisheye-type optical system 7 etc. Generally, image information inputdevice 35 may be attached in a case of an image of a wide area image,and three-dimensional image input device 36 including independent firstfisheye-type optical system 10 and CCD two-dimensional array sensor 9with respect to a left and right eyes may be attached in the event of aimage of a three-dimensional wide area image, and high magnificationimage input device 37 including an optical system with a long focallength and an image pick-up element may be attached in case of anenlargement image.

In this diagram, to shorten a depth of an image display device, afolding mirror is used in second fisheye-type optical system 7 of imageoutput devices 34L and 34R that are an image information output deviceand liquid crystal two-dimensional output device 6 is arranged in alateral direction. As a resolution of an image of this device largelyrelies on a size of a liquid crystal element, it is desirable to becomea large image as much as possible by the second fisheye-type opticalsystem 7 and to decrease the size of the liquid crystal element relativeto the image.

Regarding the large image, use of a non-telecentric optical systemenables to design an overall fisheye-type optical system to be compactand thereby permits to get a large screen of a liquid crystal section.But, in this case, an illuminating light beam of the liquid crystalsection is required to have a direction in correspondence to thefisheye-type optical system. Furthermore, splitting of light flux anduse of the liquid crystal section of three pieces of G, B and R used ina projector make it possible to enjoy a high resolution image equivalentto a projector at a wide field of view although a physical size becomesbulky.

Furthermore, use of the liquid crystal section of three pieces of R, Band R brings about an advantage that an adjustment of each magnificationof G, B and R against lateral chromatic aberration produced by a relaylens optical system enables to reduce a number of achromatic lenselements. But, as described before, as the image output device in itselfbecomes bulky, there is a disadvantage that a device mounted on a headsuch as a head-mounted display or glasses-type display is too heavy. Inorder to improve this, there is a way in which the image output deviceis fixed somewhere other than the user, but this has a problem that afixed position does not permit to deal with any posture of the user andcauses the user a sense of restraint. To solve this problem, asdescribed later, it is desirable that at least a part of the imagedisplay device be constructed so as to be supported somewhere ratherthan the user to contact with a face of the user, and to be movablecorresponding to a movement of the user's face.

On the contrary, liquid crystal two-dimensional output device 6 may bereplaced with something like a photographic film taken with the firstfisheye-type optical system. By moving the film with a revolver or aslider, an image such as a projected positive film when illuminated bylight can be enjoyed. Such the arrangement can be used as a toy or awayof storing a picture and in any case, the embodiment permits anobserver/user to feel a sense of realism that has never been experiencedbefore.

In the foregoing explanation, it has been given on a basis of theembodiments using primarily the elliptical mirror, but in the case ofthe foregoing configuration, a focus position of a Z direction, that is,an image plane does not become completely symmetric even by way of twoelliptical mirrors. FIG. 17 is a view showing a position with “o” whereparallel flux incident upon crystal ball A from three differentdirections are converged within a fisheye optical system using twoelliptical mirrors. Like this, it can be seen that asymmetry of a largeimage plane occurs due to a direction of flux and thus it becomesnecessary to deepen a deep depth of focus by considerably stopping downan image output from liquid crystal two-dimensional output device 6around a pupil or a correction optical system that corrects asymmetry ofthis image plane is needed.

However, a field of view covering a continually moving eyeball cannot begained with the foregoing arrangement, so it becomes necessary toalleviate asymmetry of the image plane. In FIG. 18, in order to solvethis problem, correction optical system 43 is inserted in proximity to acommon focus position of both of elliptical mirrors 16 and 17 so thatthe asymmetry of the image plane is alleviated. Correction opticalsystem 43 employs an aspherical lens that has an action of a lens of astrong power letting a focus in front of correction optical system 43 beformed again and an action of a lens of a weak power in its orthogonaldirection. This arrangement enables to change each focus position freelyand obtain a wide field of view in a state of the asymmetry of the imageplane being alleviated.

An application example using fθ mirror will be described below. Ashortcoming of a technology using the fθ mirror is that the fθ mirrorcannot get a wider field of view than an elliptical mirror. To improvethis, a method of making a wide field of view of a human being smallfirst and then using the fθ mirror is effective. This method will beexplained using FIGS. 19, 20 and 21.

FIG. 19 is a method in which a reverse fisheye lens system (this systemfunctions as an eyepiece optical system) is arranged at eyeball 44 and avirtual image corresponding to a wide field-of-view image projected on aretina of eyeball 44 is created. Light flux that has a position offorming an image on the retina of eyeball 44 is overly deflected byeyepiece lens 45 of a flat surface that faces eyeball 44. At a surfaceof eyepiece lens 45 opposite eyeball 44, a lens of a curvature such thata centre of the curvature of the surface becomes approximately a centreof eyeball 44 is employed and light flux incident upon the curvedsurface is approximately orthogonal to a line tangent to the curvedsurface. Furthermore, a surface of lens 46 facing eyeball 44 is also aflat surface and light flux incident upon a curved surface thereofformed on a surface thereof opposite eyeball 44 is approximatelyorthogonal to a broken line of the curved surface by using apredetermined curvature and lens materials. The foregoing conditionsbeing satisfied, a faithful image can be obtained without practicallyproducing coma on both of the flat and curved surfaces (chromaticaberration is not referred to herein, but it is necessary to consider itwithin a whole system covering from the liquid crystal device toeyepiece lens 45, so nothing is described specifically here).

But, at this stage, light flux emitted from eyeball 44 still tends todisperse. Therefore, it is desirable that the fθ mirror be used in orderto relay the light flux to a liquid crystal two-dimensional outputdevice of a predetermined size (in the foregoing description, for aconvenient sake, it is described that light flux is emitted from aneyeball, but in fact, the light flux from the liquid crystaltwo-dimensional output device reaches a retina of eyeball 44.).

An explanation about configuration 55 of an optical system will be givenusing FIG. 20. Light flux emitted from liquid crystal two-dimensionaloutput device 54 becomes dispersing light flux by lenses 53, 52 and 51constituting a second fisheye-type optical system and the dispersinglight flux becomes parallel light flux with fθ mirror 50. The parallellight flux enters inside eyeball 44 at a wide viewing angle as convergedlight flux by line symmetric fθ mirror 49 arranged opposite fθ mirrors50 such that a pupil position of this optical system becomes a centre offθ mirrors 50 and 49, and then an image of two-dimensional liquidcrystal output device 54 is formed on the retina by the reveresfisheye-type optical system of eyepiece lens 47 and lens 48 as describedin FIG. 19. With this arrangement, as a broadening angle of light fluxis broadened by lenses 53, 52 and 51 and the fθ mirror is used, and thebroadened broadening angle of the light flux is restored to the originalangle thereof again by the reverse fisheye-type optical system ofeyepiece lens 47 and lens 48, and the light flux of the restoredoriginal angle enters eyeball 44, this arrangement enables to obtain awide field of view more effectively than the fθ mirror as describedbefore in FIGS. 3 and 4. FIG. 21 shows that such systems 55L and 55R areseparately arranged to each of left and right eyes, wherein anasymmetric image plane at using the elliptical mirror is not formed.

But, when the foregoing arrangement is used, an asymmetric image planeis not formed, convex-type curvature of field easily produced when usinga fisheye lens is not corrected and remains as it is. The closer to anedge of the image plane, the larger this curvature of field and thus itbecomes necessary that a pupil be stopped down.

Therefore, another example in which this curvature of field is correctedby way of a curved mirror will be described referring to FIG. 22. For asimple sake, FIG. 22 shows an example in which principal rays ofdiverging light flux emitted from centre 0 of spherical surface 56become parallel using the arrangement as described in FIG. 19 and simplyshows that distortion has a shape like y=sin θ (θ is an angle from acentre of an object). Namely, when there is no curvature of field, letfifty-ninth (59) be a surface of forming an image and then a realsurface of forming an image is as indicated by fifty-seventh (57) andlet y be a distance of surface 59 of forming an image in the case ofnon-curvature of field and a distance of real surface 57 of forming animage, hence y=sin θ as shown in FIG. 22.

This means that ideally, light emitted from the flat surface of formingan image must converge at point O, but in actual fact, the light emittedfrom surface 57 of forming an image converges at point O due tocurvature of field.

If this parallel light flux is reflected with a flat surface mirror, acondition of curvature of field remains unchanged at all. But, whencurved mirror 58 of a predetermined curved surface is arranged inproximity to this surface 57 and reflects the parallel light flux, afocus position varies depending upon the curved surface.

For instance, principal ray e enters curved mirror 58 at right anglesand is formed at point B on a surface of curved mirror 58 at a centreposition of curved mirror 58, so this is the same that each beam oflight d, f and e is reflected by a flat surface mirror and a position ofa virtual light source of the reflected light remains unchanged at pointB. But, beams of light a, b and c forming at point A in the neighborhoodare reflected toward directions of a′, b′ and c′ by curved mirror 58 anda virtual light source of the reflected light is formed at a position ofA′. Similarly, beams of light g, h and i forming at point C in theneighborhood are reflected toward directions of g′, h′ and i′ by curvedmirror 58 and a virtual light source of the reflected light is formed ata position of C′. Like this, when a reflection surface of curved mirror58 is formed such that A′, B′ and C′ are formed on image-forming surface59 of the same flat surface, curvature of field produced by sphericalsurface 56 can be eliminated by using the reflection by curved mirror58.

Conversely, when the curved mirror reflects light flux to be formed onimage-forming surface 59 of a flat surface, the real image-formingsurface becomes fifty-seven (57) and a formed image thereon hascurvature of field. As this beam of light passes through curved surface56, the curvature of field is cancelled out and the beam of light isformed at the centre of curved mirror 56.

This curved mirror can optionally adjust a virtual focus point dependingupon various conditions, but in compensation for of this adjustment isthat telecentricity tilts, namely, principal ray emitted from an objectsurface does not become parallel to an optical axis, so, if an extremecorrection is made, a tilt of telecentricity becomes large and thusthere is a risk that light flux might go out of an effective lensaperture. Therefore, it is desirable to use an aspherical surface thatlets an incident angle of the light flux and the curved surfaceintersect approximately at right angles such that a reflection surfaceof the curved mirror comes within depth of focus and telecentricity isnot overly deflected at a part where a N.A. is small and the depth offocus is shallow, and lets the virtual focus point lie on image-formingsurface 59 of a flat surface in proximity to a centre where the N.A. islarge and the depth of focus is shallow.

Thus, the foregoing ideal image-forming surface can be obtained by sodesigning such that a curvature of an aspherical reflection surface ofcurved mirror 58 becomes an integral surface of a tangent surface thathas a middle tilt of a tilt of a surface tangent to each curved surfaceof curvature of field and the virtual focus point surface at eachposition and a tangent surface having a middle tilt between the tilts ofeach tangent surface.

An example of a preferred embodiment of display device 75 using thistechnology will be described below in reference to FIG. 23. An upperside of this diagram represents a front-side direction of viewing.Polarizing beam splitter 65 reflects light flux emitted from liquidcrystal panel 74 via lenses 73 and 72 and the light flux makescircularly polarized light by λ/four-plate 66 and then lenses 67 and 68form post-correction image plane 71 in proximity to correction curvedsurface 70 of curved mirror 76′. Post-correction image plane 71 formedis a flat surface, so that a projected image is also approximately flat(equivalent to image-forming surface 59 of the flat surface in FIG. 22)since a surface of the liquid crystal panel is a flat surface. Beingreflected by correction curved surface 70, the light flux is formed onpredetermined curved image plane 69 as described in FIG. 22.λ/four-plate 66 and polarizing beam splitter 65 are for gaining a lightamount and thus, when the light amount is sufficient, a conventionalhalf-mirror can be substituted for them and λ/four-plate 66 can beomitted, too. Also, when a liquid crystal member of three-piece G, B andR is used, three liquid crystal elements have an inherent specificpolarized azimuth, so, in the event that λ/four-plate 66 is used, it isnecessary that an attention like implementing random polarization etc bepaid.

Light flux reflected on correction curved surface 70 and emitted from avirtual image formed on curved image plane 69 become straight polarizedlight by λ/four-plate 66 via lenses 68 and 67 and the straight polarizedlight transmits through polarizing beam splitter 65 and further passesthrough crystal ball 61 by fisheye-type optical system 64, and an imageon a surface of liquid crystal panel 74 is clearly projected onto retina60 of eyeball 62. Namely, curved image plane 69 is a surface such thatlight exiting from the curved image plane 69 cancels out curvature offield of second fisheye-type optical system 64 and is formed on retina60, and a shape of correction curved surface 70 is determined such thatthe image of liquid crystal panel 74 formed on post-correction imageplane 71 formed after correction forms image plane 69 of such the curvedvirtual image.

This embodiment enables to correct curvature of field produced by thefisheye-type optical system, so this embodiment can be applied to animage pick-up device having the same distortion characteristics as thisinvention. FIG. 24 is a schematic view of image pick-up device 90,wherein a lower part of this diagram represents a direction of viewing.Light flux from an external passes through aperture stop SB and enterslens systems 89 and 88 constituting a fisheye-type optical system withan angle of an order of 140 degrees and after transmitting throughdeflecting beam splitter 82, the light flux reaches correction curvedsurface 84 via λ/four-plate 81 and lenses 87 and 86.

As lens systems 89 and 88 constituting a fisheye-type optical systemhave strong curvature of field, an image-forming surface becomes acurved image-forming surface as shown by eighty-eight (85). But, withreflection by correction curved surface 84 of curvature-of-fieldcorrection mirror 90′, curvature of field is corrected as describedbefore and an image-forming surface of reflected light becomespost-correction image-forming surface 83 of a flat surface. Then, lightemitted from post-correction image-forming surface 83 is reflected bydeflecting beam splitter 82 via lenses 87 and 86 and λ/four-plate 81 andis introduced to pupil variable aperture 79 by lens 80. Light flux thatis stopped down to a predetermined size by pupil variable aperture 79 isaffected by actions of lenses 78 and 77 and then an image of an externalworld is projected on CCD two-dimensional array sensor 76.

An image-forming surface in proximity to CCD two-dimensional arraysensor 76 is curved and, in fact, lies at a position of predeterminedradius R that is a distance from lens 89 up to CCD two-dimensional arraysensor 76. Accordingly, an image existing at a radius rather thanpredetermined radius R is configured to be out of focus. Herein, themore pupil variable aperture 79 is stopped down, the smaller N.A and thedeeper the depth of focus, so it becomes possible to focus on an objectin a radius of a predetermined broad range.

In a case where information output from CCD light sensor element 76 isplayed back with display device 75 as shown in FIG. 23, a clear imagecan be played back at a focus position by opening pupil variableaperture 79 and incorporating a focus device into image-forming device90 although an image outside of the focus position becomes blurred whena clear image is required. Contrary to this, when information in allrather than a clear image is needed, an image of great depth of focuscan be enjoyed by stopping down pupil variable aperture 79 when theimage is played back with display device 75.

Like this, by way of display device 75 and image-forming device 90 asshown in FIGS. 23 and 24, a system capable of observing an image of ahitherto unseen wide view can be achieved. However, it cannot be saidthat the foregoing arrangement makes the most of an effect of thisinvention fully and further improvement makes it possible to discoverhigh value thereof. Thus, a product profile making the most of thisinvention will be further made clear and a system to achieve thisinvention will be explained below.

Let an object to achieve with a system capable of outputting a wide viewon a display device be more specific as follows.

-   -   1. Do not get felt eyestrain    -   2. Get realism of a cinema theater exceeding a projector    -   3. Get a high image quality better than a projector    -   4. Get a three-dimensional image without an uncomfortable        feeling    -   5. Get a new function of a high value added exceeding a human        eye

Regarding 1, a necessary system becomes clear with an analysis andimprovement of eyestrain. First of all, position eyestrain as apresent-day disease and consider a system that eliminates its cause.

(1) Long-Hours Use of a TV and Computer

A display stays nearby us and an eye is kept on a screen. =>Desire toview something different and far ahead. As for an order of fatigue,TV>projector>cinema theater =>Viewing something at a long distance doesnot cause an observer eyestrain.

(2) Use of a Commercially Available Wearable Display Device

(a) A viewing angle is narrow (30 degrees) and a focus position is fixed(2 m ahead). =>Obtained information is so limited. =>In a video game, aneye is shifted laterally (a lateral eye movement)(a wide angle) andthing rather than a video screen can be viewed at a wide viewing angle(a wide angle and a variable focus position). (b) Workload takes placeto the observer when focusing eyes. An image quality is inferior to atypical TV.

(3) Keep on Chasing a Fast Moving Subject

In a train and a vehicle in an amusement park, an actively moving andnearby object is viewed. =>Swaying a head lets a line of sight be fixedor a still subject is found out and it is viewed.

With consideration of the foregoing results, high likelihood conditionsthat do not cause eyestrain are to broaden a field of view, enhance animage quality, enable to sway an eye laterally and view a subject atinfinity, have a different focus point at a plurality of focus pointsand secure a motionless image within a field of view. By satisfying suchthe conditions, eyestrain can be alleviated.

Next, Let's talk about realism of a cinema theater exceeding a projector(2). A human being feels a perspective by making both eyes cross-eyed.An amount of cross-eyed determines a focus position arbitrarily. Even byway of a high performance projector, a projection distance exists asbelow and a wide image at a long distance cannot be enjoyed in a spaceof a house like in a cinema theater house.

FIG. 25 is a view explaining the above description understand ably,wherein, for instance, when an image output from a liquid crystalelement projected onto field of view of a human being is an image atinfinity, as shown in (b), the image is projected such that each imagecan be viewed at positions of aL and aR on parallel light flux. But,when the image lies at a close distance, as eyes are cross-eyed andthereby a focus of eyes is arbitrarily so set as to see things at aclose distance, so the image is projected such that the image outputfrom liquid crystal element gets close inside and each image is viewedat positions of bL and bR and it is necessary that focus of a projectionoptical system up to crystal balls 2L and 2R and an image output from aliquid crystal two-dimensional display device be aligned with thepositions of bL and bR accordingly.

In this case, it is conceivable that the image output from the liquidcrystal element is shifted electrically or with a software application,but optical harving may be used.

When the optical harving is used, as there is no loss of data on amarginal area, the optical harving has an advantage that the opticalharving can secure a broader field-of-view image than the shift by theelectrical process or software application. Namely, if the image displaydevice is configured such that a virtual image plane can be createdoptionally from a close-up image to an infinity image like points c, d,e and f in FIG. 25 (a) by including the focus device and givingprojection images of both eyes the lateral shift, it becomes possible tofeel realism exceeding a cinema theater as if a screen floats in a sky.

Next, let's touch on item 3 “Get a high image quality better than aprojector”. Currently, there are varieties of projectors available onthe market from so-called QVGA of resolution: (number of horizontalpixels) 320×(number of vertical pixels) 240 dots to SXGA of three-timeresolution of 1280×1024 dots wherein a color image of 1280×1024 dots isseparately created by three pieces of GRB liquid crystal elements andthree images are put together to one image of three-time resolution of1280×1024 dots.

If this embodiment of this invention uses a device of a low resolution,its liquid crystal element is visible in a large screen like a cinematheater size and thus realism gets lost. Therefore, when an imagequality better than that of a projector is desired, it is requisite toadopt a so-called SXGA technology in which a color image of 1280×1024dots is separately created by three pieces of GRB liquid crystalelements and its resolution is boosted to three-time resolution bycompositing, and if this technology has a priority over others by allmeans, a glasses-type display device or a head-mounted display devicebecomes intolerable in its size as well as weight.

Then, as an example, an embodiment of this invention adopts afloor-standing type display device with a 360-degree viewing angle asshown in FIG. 31. Although the display device may be fixed onto a chairand/or a bed, this floor-standing type display device is perceived as abest when considering its ease-of-use mobility in a house. This systemcan be connected to DVD, video cassette deck and TV image output device114 etc and is also connectable to a personal computer and video gamedevice 113 etc like a conventional projector. This system is designedsuch that image composite/converter 121 converts images of these currentcontents to non-distorted images on a display device and a plurality ofimages can be displayed at a time on a display device.

With this system, image information from output device 114 and videogame device 113 can be displayed by converting the image informationwith whole viewing angle display device 118 supported by anti-vibrationarticular bar 116 having a plurality of articular sections via supportsection 115 of an extensible extension bar. Herein, this system isprovide with weight member 117 to cancel out weights of anti-vibrationarticular bar 116 and whole viewing angle display device 118 and aarticular system is devised such that a user does not feel its weightand further the system follows a face movement.

Basically, a user feels only inertia force in moving anti-vibrationarticular bar 116 and whole viewing angle display device 118, and thus,with adoption of this system, a high quality image can be obtained.Furthermore, with adoption of this floor-standing display device, thehigh quality liquid crystal element can be separately arranged to botheyes, so, if a pitch between the liquid crystal elements is set so as tobe displaced by half in the right/left images, a double high qualityimage can be obtained and thus it becomes possible to get an imagequality exceeding that of a projector.

In this embodiment, the system is further provided with headphone 120for cinema and DVD entertainments, suction-type face fitting device 119allowing this system to be gently fitted on a face and microphone 127for input of a voice for use in a personal computer/e-mail etc and thissystem is configured such that virtual keyboard 122 as shown in FIG. 13and information of an operation button can be output to a peripheralportion of a display image.

Next, let's move on item 4 “Get a three-dimensional image withoutfeeling uncomfortable”. Image pick-up device 90 is already described inFIG. 24, but, FIG. 30 shows two image pick-up devices for both eyes(102L, 102R or 102L′, 102R′) basically arranged at the same spacing asthe both eyes for both eyes. When an image is output by two wholeviewing angle display devices 118 of two display devices 75 shown inFIG. 23 and is arranged at the same spacing as that of eyes for botheyes, the image can be observed as three-dimensional image. In thediagram, the image pick-up devices (102L and 102R) are arranged on imagepick-up rotary device 111 and image pick-up tilt device 112.

In an image pick-up device for both eyes as shown in FIG. 30 (b), theimage pick-up device for both eyes includes display devices 94L and 94Ron a face side that display images of image pick-up devices 102L′ and102R′. Namely, this is an example of wearable image pick-up devices witha display device.

However, such a displayed 3-D image is the same as the one seen throughpolarized glasses in a movie theater, wherein an image of an objectviewed at a close range is blurred although it looks in athree-dimensional way and is different from an image of the objectactually viewed at a close range by a human being. This is because, asexplained in FIG. 25, we cross eyes when observing an object at a closerange and then focus our eyes on it arbitrarily, so the image of theobject in itself still exists on the screen although an illusion of theobject lying at a quasi-close distance is successfully given by shiftingimages of both eyes inwards on a long-distance screen, and then theimage on the screen and the image on the retina become defocused images.

As a solution for solving this problem, in order to duplicate an imagelike a 3-D image actually viewed through eyes, an automatic focus systemis built in display device 75 as shown in FIG. 75 and a focus control isperformed based upon information about a focus/image shift of the imagepick-up devices for both eyes (102L, 102R or 102L′, 102R′), and then anyimage at any position has no artificiality and thus a clear 3-D imagecan be obtained.

Herein, focus information of the image pick-up devices for both eyes(102L, 102R or 102L′, 102R′) is information about an auto-focused imageat a centre position of the devices and is provided to whole viewingangle device 118 and display devices 94L/94R along with imageinformation. As for a method of providing, it takes a method in whichinformation is written into a portion of a storage device. As explainedabout image pick-up device 90 in FIG. 24, when pupil variable aperture79 is opened, a central image observed by the image pick-up device forboth eyes (94L/94R or 102L/102R) is seen clearly and another imageexcept for the central image is seen blurred, that is, the same image asviewed by a human being can be provided.

On the other hand, when pupil variable aperture 79 is stopped down, allimages are seen clearly to some extent, so that an illusion image can becreated such that an object at a long distance is contracted at a closerange and an object at a close range is enlarged at a long distance whenimages on both eyes are caused to be shifted intentionally on thedisplay device projecting onto a retina and a focus is set up based uponan amount in a shift. And, the focus system can provide offset on eacheye separately and thus when a suitable setting for eyesight of anobserver is implemented, there is no need for wearing glasses or acontact lens.

Lastly, let's discuss about item 5 “Get a high value added new functionexceeding a human eye”. Use of the foregoing functions so far enables toenlarge a personal computer screen at a long-distance position, sochildren's impaired eyesight due to a long-hour watching of a subject atclose distance can be prevented. Furthermore, eyestrain derived from along-hour viewing of a personal computer's display can be improved by aneffect of this invention.

An embodiment of this invention to achieve all of 1. Do not get felteyestrain, 2. Get realism of a cinema theater exceeding a projector, 3.Get a high image quality better than a projector, 4. Get athree-dimensional image without an uncomfortable feeling, and 5. Get ahigh value added new function exceeding a human eye as described abovewill be described below in reference to FIGS. 28 and 29.

FIG. 28 is a view to explain display device 94 and FIG. 29 is a view toexplain image pick-up device 102.

FIG. 28 has common parts in the device in FIG. 23, so explanations aboutthe common parts will be omitted herein and a different point will bemainly explained. Furthermore, a following explanation refers to only apart of a left-eyeball, but a part of a right-eyeball has the sameconfiguration, too and thus it is needless to say that the part of theright-eyeball provides the same function and effect.

First of all, to deal with a focus arbitrarily set with a human-beingcrossed eye, fisheye-type optical system 64 is replaced with fisheye/AF(automatic focusing) optical system 95 that arranges an automatic focuscontrol system in a fisheye-type optical system including an eyepiecelens. With arrangement of this automatic focus system, a focus controlcan be implemented with almost no change of an image-forming position bycurvature-of-field correction mirror 104 in correspondence to a state ofthe human-being crossed-eye.

In the image display device of FIG. 28, as liquid crystal panel 74, awhole field-of-view viewable VGA liquid crystal element is used.Hereinafter, liquid crystal panel 74 will be referred to as wholefield-of-view viewable VGA liquid crystal element 74. Light emitted fromwhole field-of-view viewable VGA liquid crystal element 74 transmitsthrough half mirror HM after passing through AF (automatic focus)optical system 96, and is introduced by an optical system almost equalto the one as described in FIG. 23 and then an image of wholefield-of-view viewable VGA liquid crystal element 74 is formed on retina60 of eyeball 62.

On the other hand, light emitted from high resolution three-piece SXGAliquid crystal element 101 passes through AF (auto focus) system 99, andis introduced to zoom optical system 98. Zoom optical system 98 changesmagnification by moving a negative lens back and forth. Then, The lightpassing through position shift harving 97 for two eyes is reflected onhalf mirror HM and is introduced by an optical system almost equal toone as described in FIG. 23, and then an image of high resolutionthree-piece SXGA liquid crystal element 101 is formed on retina 60 ofeyeball 62.

With this configuration, all the effects of the foregoing 1 through 5can be obtained and a new effect as shown in FIG. 26 is created. FIG. 26shows in more detail a case where an image is optically composited withthe half mirror by using a compositing method of image informationcontrol device 27 shown in FIG. 12, and shows an image on a side of theleft-eyeball as an example herein.

FIG. 26 shows a field of view of this embodiment in a two-dimensionalway as practically necessary viewing angles of −50 to +40 degrees in alongitudinal direction and −75 to +65 degrees in a lateral direction. Asa matter of course, large distortion occurs because an image isprojected onto eyeball 62 using the fisheye-type optical system, but thesame concept as the one shown in FIG. 12 may be applied to handle thisdistortion. Preferably, the foregoing problem can be solved byintroducing distortion with reverse characteristics to distortion of theoptical system projecting onto the eyeball with the optical system fromthe half mirror to the liquid crystal element, thereby. Anyway, FIG. 26(a) shows image 91 output from whole field-of-view viewable VGA liquidcrystal element 74 for a left eye, wherein the image display device isconfigured such that the image can be viewed across whole field of view.A blank portion at a centre thereof is a portion where an image iscomposited by half mirror HM and image 92 output from high resolutionthree-piece SXGA liquid crystal element 101 for a left eye iscomposited.

In the meanwhile, image 92 output from left eye field-of-view viewablehigh resolution three-piece SXGA liquid crystal element 101 is shown in(b) of FIG. 26. An angle of output image 92 is smaller than viewingangles of −50 to +40 degrees in a longitudinal direction and −75 to +65degrees in a lateral direction by using zoom optical system 98 asdescribed above. The viewing angle of the image is variable from ±15degrees (equivalent to an image of 52 inch square at 2 m ahead) to theabove-defined largest degrees, and image 92 output from left eyefield-of-view viewable high resolution three-piece SXGA liquid crystalelement 101 can be obtained as a high quality image of horizontal pixels1280×vertical pixels 760 dots.

The reason why an image to be viewed is separated into image 91 outputfrom left-eye whole field-of-view viewable VGA liquid crystal element 74and image 92 output from left-eye field-of-view viewable high resolutionthree-piece SXGA liquid crystal element 101 and the separately formedimages are composited is that viewing angles of contents about DVD,VIDEO and BS (Broadcasting Satellite) images etc currently available inthe market are predetermined and an image size suitable for its imagequality is more preferable than the wide viewing angle. Namely, if anangle of view is broadened needlessly, roughness of a pixel becomediscernible and thereby a disadvantage that poorness of an image qualityis annoying becomes larger than an advantage that a large screen isobtained. Therefore, in this embodiment of this invention, an angle ofview is set so as to be most suitable angle of view to these contents byway of a zoom unit and under any setting thereof, image 92 output fromhigh resolution three-piece SXGA liquid crystal element 101 isconfigured to be capable of obtaining a high quality image of horizontalpixels 1280×vertical pixels 760 dots at all times.

When output images 91 and 92 are composited with half mirror HM,composite image 93 as shown in FIG. 26 (c) is obtained and is projectedon a retina. If the image is processed electrically and with a softwareapplication, horizontal/vertical resolutions of 1280×760 dots are splitin accordance with an angle of view corresponding to a maximum screen,so that the resolution within a predetermined angle of view getsdeteriorated. But, use of an optical zoom is very effective in thisregard and a display device of a high image quality can be provided.

An explanation about a role of image 91 output from whole field-of-viewviewable VGA liquid crystal element 74 will be further given in detail.Output image 91 is configured to cover almost whole field of view of ahuman being and by controlling AF optical system 96, any focus positioncan be set as described above. Even if image 92 output from highresolution three-piece SXGA liquid crystal element 101 is set in such away that the image is viewed at a close distance by a control of AFoptical system 99, image 91 output from whole field-of-view viewable VGAliquid crystal element 74 is settable so as to be positioned at infinityas well by way of AF optical system 96, so that a plurality of focusimages in responsive to any of lateral brisk eyeball movements in ordernot to cause eyestrain can be provided.

Once a plurality of focus images are composited, a fixed image at adifferent focus position can be created as one image in the event thatother image displays an active movement. Namely, when a human eyefocuses on the fixed image, other actively moving image becomesdefocused and then information of a display about the actively movingimage can be alleviated from human consciousness. This can alleviate thesickness in VE developed by following an actively moving image, and, onthe whole, this is effective in relieving eyestrain.

Furthermore, in order to prevent an accident like a blackout developedwhen a child keeps on eyeballing a TV image and impaired eyesightdeveloped by viewing a 3-D image against the laws of nature, there aresome general consumer products like wearable display device etc that achildren, who is 16 years old and below, is prohibited from wearing.However, in this invention, the system is configured so as to provide aplurality of focus images and duplicate a state where a 3-D image etc isnaturally viewed with an eye and furthermore the system has a functionthat sets an image to infinity so as not to eyeball a close range objectand an adjustment system that matches spacing between eyes, so it iseffective that this invention can provide an easier image on an eye thana typical personal computer and TV entertainment.

And, by regularly outputting a character image etc to image 91 outputfrom whole field-of-view viewable VGA liquid crystal element 74 andthereby, causing viewer's attention to be directed toward output image91 intentionally, the system can be used in such a way that eyeballingimage 92 output from high resolution three-piece SXGA liquid crystalelement 101 is avoided as well, so this invention further has an easyeffect on an eye, too.

When output image 92 is changed to any size using the zoom system asdescribed above, certainly it is necessary that the zoom system becontrolled so as to limit a range of output image 91 such that thechanged size does not overlap with the image. Principally, frameportions of both images are controlled so as to slightly overlap witheach other and an overlapped portion of output image 91 is set to animage with a bright frame, the overlapped portion looks like a frame ona screen or TV and thus nobody has a sense of abnormality to a compositeimage.

And, the VGA liquid crystal element is used for the whole field of view,but if a viewing quality of an image is poor with this element, it mightlead to reducing realism, too. Inherently, a marginal image is for nothaving blackout and/or eyestrain felt and thus there is no need fordealing with a vigorously changing motion image. Therefore, a lateresponse-type liquid crystal element for a still image of highresolution used in a digital camera etc may be adopted.

A method of compositing image 91 output from whole field-of-viewviewable VGA liquid crystal element 74 and image 92 output from SXGAliquid crystal element 101 has been described so far and if thiscomposite is applied to both eyes separately, a total of four liquidcrystal elements are needed. But, this is not preferable even from aview point of a size and a cost. On the other hand, there is a method inwhich image 91 output from whole field-of-view viewable VGA liquidcrystal element 74 and image 92 output from SXGA liquid crystal element101 are optically split without having independent liquid crystalelements for both eyes and an image is separately provided to both eyes,but, in this case, a different image cannot be sent to both eyes andimage information having parallax conscious of a 3-D image cannot bedisplayed separately. Thus, FIG. 52 shows a configuration in which theimage display device uses two SXGA liquid crystal elements and a beamsplitter that composes and splits each light flux is arranged, and thenboth of the composite image and the above-mentioned 3-D image can beprovided by switching over the beam splitter to a half mirror type and atotal reflection (or a total transmission) type.

In FIG. 52, (a) thereof is an example in which images x and y differentin size are composited and the composite image is displayed (c) on leftand right eyes as the same image and x is equivalent to image 92 outputfrom SXGA liquid crystal element 101 and y is equivalent to image 91output from VGA liquid crystal element 100. (b) of FIG. 52 is an examplein which different images x and y with same size are displayed (d) onleft and right eyes as a different image. As described in FIG. 8, a 3-Dimage can be enjoyed by converting x and y images to different imageshaving parallax. (a) and (b) of FIG. 52 show optical paths of light fluxx and y when switching between half prism 153 compositing light flux xoutput from high resolution three-piece SXGA liquid crystal element 150Xand light flux y output from high resolution three-piece SXGA liquidcrystal element 150Y and optical member 154 designed so as to make itsoptical path equal to that of half prism 153.

In FIG. 52 (a), light flux y of high resolution three-piece SXGA liquidcrystal element 150Y is zoomed down to a size corresponding toresolution of an image output from content by optical zoom unit 151Y.Contrary to this, light flux x output from high resolution three-pieceSXGA liquid crystal element 150X is zoomed up to an image of a wholefield of view by optical zoom unit 151X. Light flux x and y are split byhalf prism 153 respectively and one of respective split light flux andanother of split light flux are composited and as light flux x and y,light flux x and y are projected respectively on a retinal of lefteyeball 2L and a retinal of right eyeball 2R as the same image (c) byrelay optical systems 152 y and 152 x.

On the other hand, in FIG. 52 (b), light flux y output from highresolution three-piece SXGA liquid crystal element 150Y is zoomed up toa predetermined size of an image by optical zoom unit 151Y, whereaslight flux x output from high resolution three-piece SXGA liquid crystalelement 150X is zoomed to the same size as the one of light flux y byoptical zoom unit 151X. Light flux x and y transmit through withoutbeing split/composited by optical member 154 and are separatelyprojected on retinas of left/right eyeballs 2L and 2R as respectivelyindependent image (d).

In this embodiment, both images are high quality images that use theSXGA liquid crystal element, so a clear image can be obtained even on amarginal portion of the image like (c). In this case, for instance, letlight flux y of (c) be a screen image of a cinema theater, it is good toprovide a marginal image as the image including a viewer of a cinematheater. As an image quality at a marginal portion is good, realism canbe felt as if an observer actually stays in a cinema theater and as aresult, there is an effect that an observer can enjoy an image as theimage having depth. Furthermore, there is no doubt that only two SXGAliquid crystal elements can obtain the same performance as the system ofthe total four liquid crystal elements, so this system takes a bigeffect in decreasing a cost and reducing a size.

Now, let's move on a sickness in VE (Virtual Environment) The sicknessin VE is different from eyestrain and is a phenomenon that an observerfeels when viewing a wide field-of-view image like this invention. Thesickness in VE is not limited to a display of an active movement andregarding a slight flicker of an output image due to a handshake of avideo camera, a change in scenery thanks to enlargement and contractionof an image by a zoom action of a video camera (especially, acontraction action that makes an image smaller creates an image that canbe perceived when a human being drives backwards at a high speed andthis image does not exist as a past memory. That's why people are proneto the sickness in VE when observing a rear scene in a car.) andregarding an observation image of a wide area scenery captured byturning a video camera laterally etc, generally, a brain getsuncomfortable feeling against an image of moving scenery although theobserver does not move at all, and in some cases, observers startfeeling bad as the sickness in VE. Especially, this feeling is stronglyfelt when scenery flows in an observer's line of sight and the higherresolution of an image, the wider a field of view, the sickness in VE isfelt at the same time when obtaining realism and a sense of 3-D andnobody can escape from this phnomena.

This invention proposes to use an optical zoom for maintainingresolution of an image at a predetermined level and with regard to amoving image, it is enough to make an image size small, but this is noteffective in order to obtain realism by way of a screen of a wide fieldof view. The reason why generally, a movie image does not cause thesickness so much is that the movie uses a lot of images captured with afixed camera of paying an attention to the sickness or images from aleading actor/actress's point of view with reference to an object at acenter. However, a DVD image, HD image, satellite broadcasting andterrestrial broadcasting images that are not assumed to be shown at acinema house are not created on the assumption that they are projectedon a wide field-of-view screen and therefore, if they are made widefield-of-view images forcedly, it might cause the sickness.

Then, as a method in which a wide field-of-view image does not cause thesickness in VE as it is, a control method in which image information istemporally taken into an internal storage device and then the imageinformation is processed in correspondence to an image movement, and theinformation that is stored again is shown to an observer is conceivable.In this case, firstly, image data of DVD, satellite, high vision andterrestrial broadcastings are captured into an internal buffer and animage output from the internal buffer is divided into a marginal imageblock and a central image block. A lateral shift amount of content of animage in each block during a predetermined period of time is computedand when content included in the marginal image block and contentincluded in the central image block are shifted toward the samedirection, it is judged that these shifts are attributed to a hand shakeor a lateral screen movement and then images are processed such that animage bit as a whole is shifted by the same amount as the movementamount toward a direction opposite a direction of content movement insuch a way that the image does not move laterally during thepredetermined period of time and thereby a whole screen looks still.

Of course, as the marginal image gets lost due to a relative shift of animage, it is necessary that the marginal image portion out of displayimage information be secured for a shift correction of an image whenthis control method is used.

When this relative shift amount is larger than an image portion for amarginal correction, a method for switching over to a next screen withno relative shift is taken. Namely, a small movement like a handshake iscompletely corrected and an image that moves in an observer's line ofsight like a flowing scene becomes an image as if a camera's image-pickup position is shifted a little bit one after another. This is the samemethod as the observer blinks while the scenery moves in the line ofsight when an observer views scenery of a wide area and there is no needfor viewing a brisk flow of the image as it is, and thus this enables todecrease outbreak of the sickness in VE.

This is the same even in a case where an device of this invention isused in a 3-D video game with a player's point of view, wherein apicture image of the conventional image display device that causes thesickness in VE by seeing flowing scenery with a movement of a joystickthat changes an angle of a line of sight is changed into a picture imagesuch that a whole screen thereof is switched over sequentially one afteranother like blinking during a scene movement in a player's line ofsight. This enables a reduction in the sickness in VE attributable to awide field-of-view image. Obviously, this sickness in VE occurs becausea brain gets confused due to non experienced encounter in the past, sothe sickness will be improved by getting used to it.

Thus, use or non-use of this picture image change mode is configured soas to be freely selectable via ON/OFF switch. As for a child, patientand relaxation-oriented user, it is effective that the sickness in VE isprevented by way of the picture image change mode and it is preferablethat a non-processed image be provided to an attraction and game thatenjoys the sickness in VE. Inherently, as an output of a widefield-of-view image requires distortion correction, it is desirable thata distortion correction and the preventive sickness in VE processing beperformed in the same control system.

Furthermore, in addition to preventive measures of the sickness in VE,it is important that tiredness is not felt and to this end, it isnecessary that a suitable image for an eye of each person be provided toleft/right eyes. A space between human eyes is an order of 6.5 to 7.5 cmand with some adjustment of a space between right and left images, animage having no abnormality and no eyestrain can be provided.

When providing an infinity image, it is necessary that images of leftand right eyes be set at a distance matching a space between observer'seyes and to this end, calibration is required when an observer wears aproduct of this invention. Calibration is an adjustment method in whicha cross-marked image is presented alternatively to the left and righteyes and a state of the cross-marked image looking double is adjustedsuch that the cross-marked images overlaps. Both images can be adjustedby a harving system or an adjustment of a digital image by way of asoftware application by changing a space between both images, and thus aspace between observer's eyes is calibrated by an input via an inputmember such that the cross-marked images overlap by way of an observer'sline of sight.

Herein, it is necessary that the cross-marked image be adjusted toward adirection where the space between the cross-marked images is shortenedas a default of a direction where the cross-marked images exist apart.This is due to the following reason. When an observer is in a state ofviewing a close range image, it is easy to view the cross-marked imageby overlapping, but when the cross-marked image is spaced farther awaythan a space between the left and right infinity images equal to a spacebetween both eyes, a human eye cannot view them by overlapping. Thus, bydefaulting the direction of the cross-marked image apart from eachother, a space between eyes can be easily measured when an object is atinfinity, not at a close range.

Next, an example of an embodiment of image pick-up device 102 will bedescribed in reference to FIG. 29. FIG. 29 has many common parts as thedevice of FIG. 24, an explanation about the common parts will be omittedherein and a different part will be mainly described.

First, when focus is achieved using a focus control device of AF opticalsystem 109 arranged in front of CCD two-dimensional array sensor 110, aposition of forming an image at curvature-of-image correction mirror 90′varies. To correct this, AF optical system 109 is replaced withfisheye/AF optical system 103 that has lenses of the samecharacteristics as lenses 88 and 89 of FIG. 24 arranged on an objectside and further has an automatic focus control system is used.

In FIG. 29, image pick-up device 102 is configured such that an externalimage is projected on CCD two-dimensional array sensor 110 via zoomsystem 107, pupil variable aperture system 108 and automatic focus (AF)system 109 after light flux is deflected by mirror 105.

Furthermore, states of a zoom and focus are stored, and information ofthe states of the zoom and focus are send to whole viewing angle displaydevice 94 and then with duplication of all the states faithfully,distortion characteristics can be made same and thus a electric andsoftware application distortion corrections by an imagecomposition/converter device are not required and a faithful image canbe obtained.

(a) of FIG. 27 shows a state where an image is output from currentcontent, whereas (b) thereof is a view showing a case where informationfrom image pick-up device 102 is configured to be viewable on a wholefield-of-view screen. This can be achieved by matching zoom system 107to a status of the whole field-of-view image and matching zoom system 98within whole viewing angle display device 94 to the same status.

Herein, when a projection image is set to become larger than aneffective angle of view of the CCD two-dimensional array sensor bydriving a zoom system of image pick-up device 102, image pick-up device102 becomes a fisheye-type optical system that has a zoom system and canenlarge a central portion of an external image. If output imageinformation is observed on whole viewing angle display device 94 whilefixing the zoom system, an image that enlarges the central portion ofthe whole field-of-view image can be observed. In this case, asdistortion states of the zoom system and the whole viewing angle displaydevice are different from each other, it is necessary that distortion becorrected electrically and in a method of a software application. But,an enlarged image of high resolution can be obtained even when comparingwith a method in which a portion of an image obtained by a conventionalfisheye-type optical system is cut out and then the cut-out portion isenlarged. Therefore, this invention works well with respect to usagenecessary to enlarge a specific portion from a monitoring of a wide areasuch as security and disaster precautions and wild animal watching etc.

Fixed-type image pick-up device 102L and 102R shown in FIG. 30 (a) maybe used in the security and disaster precautions and wild animalwatching etc. Furthermore, as shown in FIG. 30 (b), display devices (94Land 94R) are used and actions of a head's upward/downward andrightward/leftward movements of an observer wearing whole viewing angledisplay device 118 are detected, and by directing the same action as theone of the human head movement to image pick-up devices (102L and 102R)by way of a remote operation, thus, the same realism as the head pointsat directions of upward/downward 90 degrees and rightward/leftward 360degrees at a place where the image pick-up devices (102L and 102R) arearranged can be enjoyed at any place.

However, when information of an image and operation is transmitted via awireless or the Internet, a volume of image information becomes largeand thus a long-hour transmission becomes a brake. Therefore, it may bedevised such that an image is transmitted in a way like a frame-advancestill picture instead of a motion picture, and thus a situation on thespot is instantaneously known.

The (b) of FIG. 30 is a wearable image pick-up device with displaydevices (102L′, 102R′, 94L and 94R) and since it is sufficient to becapable of checking only how a taken motion picture looks like from aview point of the display device, a low priced and lightweight liquidcrystal element as shown in FIG. 24 can be used and designed so as to beportable. With these image pick-up devices (102L and 102R), the wholefield-of-view image and the 3-D image can be obtained anywhere and thus,it can be expected that a market expands as a new content and newopportunities come into bud in many business areas.

FIG. 32 shows that whole viewing angle display device 118 as shown inFIG. 31 is used while the observer lies on his/her back. Providing of arealism-packed image to movement restricted patients and bedriddensenior citizens has a big relaxation effect and marketability of theimage full of realism is large from a potential business point wherevigor for recovery from illness and for living can be given.

FIG. 33 is a schematic cross-sectioned view taking a side view of wholeviewing angle display device 118 of FIG. 31. As shown in the diagram, anecessary viewing angle of a longitudinal direction is narrower thanthat of a lateral direction, so a deflecting direction of polarizingbeam splitter 65 is made into the longitudinal direction so thatpolarizing beam splitter 65 can be designed to be compact. Further, inorder to use a space efficiently, it is desirable that, in each opticalsystem, a part where light flux does not pass through be cut in thelongitudinal direction.

As shown in FIG. 33, whole viewing angle display device 118 has asuction-type face fitting unit. By sealing across a wide area of a spacebetween a body of whole viewing angle device 118 and a face by contactmaterial 124T and setting a slightly negative pressure in the inside bysuction device 123, the viewing angle display device 118 is designed soas not to a sense of abnormality felt around a nose when wearing glassesand a feeling of fastening to an ear when mounting a headphone. Ofrecent, many of minus ion or fragrance generating devices have beendeveloped and incorporation of these devices into the display devicetakes a further relaxation effect. Furthermore, as contact material 124Tdoes not completely seal the space, so an inside air is not built up anda wind is felt to some extent, so the display device is devised so asnot to be offensive to a wearer. In addition, contact material 124T hasa function such that a space between an eye and an eyepiece lens is notcontracted than a predetermined space and therefore, safety designing iscarried out.

In contact material 124B at a lower portion of contact material 124T,transparent material 125 capable of observing an external is arrangedentirely below an eye so that a wearer can have a glass of water etcfrom water cup 128 etc while wearing the body of whole viewing angledisplay device 118. Contact material 125 is composed of a ND (neutraldensity) filter that limits an incident light amount such that lightincident upon a display image of the internal from an external does notdeteriorate an image quality.

FIG. 34 is a plane view taking a top view of whole viewing angle displaydevice 118 of FIG. 31, wherein anti-vibration articular bar 116 supportsthe body of whole viewing angle display device 118 via articular member126, but its supporting position is arranged at a position of acentre-of-gravity of the viewing angle display device includingheadphone sections 120L and 120R. With this arrangement, the body ofwhole viewing angle display device 118 is designed so as to be able tomaintain its posture and is constructed so as to be able to be mountedwithout an uncomfortable sense even when taking a seat or lying onhis/her back. Because, weight member 117 balances such that an observerdoes not feel a weight of the body.

With contact material 124T, headphone sections 120L and 120R are alsoplaced at a close contact with a head so that a wearer does not get afastening feeling or an ear's pain unlike a conventional headphone. In acase of dismantling the body of whole viewing angle display device 118from a head, headphone sections 120L and 120R are opened rightward andleftward shown by broken line in the diagram and then the internalnegative pressure gets back to an atmospheric pressure. This enables toremove the body thereof from a head easily.

Next, an example of a simple optical design will be described. FIGS. 35and 36 are the same optical design and FIG. 35 shows light flux of ±70degrees when a crystal ball moves by 20 mm with consideration of a humaneye's brisk lateral movement. (a) section of an optical system iseyepiece lens group including a Conic surface, wherein a hyperboloidlens is used on a side of a pupil in an eyepiece lens in order tosuppress coma. Its curved surface Z(r) is represented by${Z(r)} = \frac{c \times r^{2}}{1 + \sqrt{\left\{ {1 - {\left( {1 + k} \right) \times c^{2} \times r^{2}}} \right\}}}$where c is curvature, r²=x²+y², k is a Conic coefficient and K<−1 isused.

Coma is improved, but, large curvature of field occurs due to use of thehyperboloid lens and telecentricity of each light flux is overlydistorted at a position of forming an image emitted from an exit pupilof eyepiece lens group (a) (a conjugate position in a relation to aretina). When the image formed at this position of forming the image isrelayed to curved surface mirror (c) by way of relay lens group (b),naturally, the large curvature of field and the distorted telecentricityare duplicated. But, this curved surface mirror (c) has an effect thatreverses a curved direction of curvature of field produced on an imageformed by reflected light flux, thus curved surface mirror (c) isdefinitely requisite to obtain an almost flat image plane on final imageplane (f) projected by objective lens group (d) after the image isdeflected by half mirror HM arranged in proximity to the pupil.

In FIG. 35, although spherical aberration seems to be large, but this isfor checking vignetting and it can be said that spherical aberration andcoma herein can be substantially neglected when the spherical aberrationand coma are checkable with a real pupil (suppose that the size of thehuman pupil is 3 mm when viewing an object indoors).

Furthermore, with arrangement of the curved surface mirror in proximityto a surface of forming an image, coma and spherical aberration producedby the mirror reflection can be reduced. Furthermore, arrangement ofcurved surface mirror (c) at a position a little bit deviated from thesurface of forming an image enables to produce coma and sphericalaberration intentionally and correct the coma and spherical aberrationso as to cancel out coma and spherical aberration produced by lensgroups (a), (b) and (d).

Furthermore, as shown in the diagram, a tilt of telecentricity (adifference in an incident direction of each principal ray with respectto the reflection surface) is overly different on curved surface mirror(c) depending upon an incident angle upon the eyepiece lens section. Tocorrect this, curved surface mirror (c) is made into an asphericalsurface mirror and thereby it becomes necessary that the tilt oftelecentricity be changed forcibly.

Herein, curved surface Z(r) of the aspheric surface mirror isrepresented by${Z(r)} = {\frac{c \times r^{2}}{\left\{ {1 + \sqrt{1 - {\left( {1 + k} \right) \times c^{2} \times r^{2}}}} \right.} + {A \times r^{4}} + {B \times r^{6}} + {C \times r^{8}} + {D \times r^{10}} + {E \times r^{12}} + {F \times r^{14}} + {G \times r^{16}} + {H \times r^{18}} + {J \times r^{20}}}$where curved surface Z(r) of the aspheric surface mirror is arotationally symmetric quadratic curve, c is curvature, r² =x²+y², A, B,C, D, E, F, G, H and J aspherical coefficients (even number order), k isa Conic coefficient, k=−1 and a saucer-shaped curved mirror ofa>1.0*10⁻⁷ (but, a mirror is a concave surface. In a case of a convexsurface, a<−1.0*10⁻⁷) is used.

Then, as shown in FIG. 35, it can be seen that all light flux isprojected without vignetting. FIG. 36 shows light flux in a case whereall light flux is sure to be projected without vignetting and a pupilwith a size of an eye pupil set to an order of 3 mm being a normal sizeindoors is directed to an optical axis. FIG. 36 shows light flux of 0,10, 20, 30, 40, 50, 60 and 70 degrees and it can be seen from FIG. 36that an image of a small aberration is formed on a flat image plane.Furthermore, the tilt of telecentricity is linearly corrected across allthe light flux, too and the display device is so configured as to easilyincorporate the zoom system, automatic focus system and harving systemas described.

Another example of an optical design will be described. The foregoingembodiments assume that the focus position varies to some extent inresponsive to the human eye's lateral brisk movement and then the humaneye focuses on an object following this variation of the focus position.FIGS. 37, 38 and 39 show the same design examples, wherein FIG. 38 is aview of a ray of light when an eye moves laterally (eye's lateral briskmovement). FIG. 37 shows an example in which a human eye does not see awide range accurately at the same time, but clearly sees only a range of±few degrees from a centre at which the eye points and therefore, byusing this, defocused curvature of field is intentionally introducedcorresponding to a viewing angle from the center that the eye sees. Andfurthermore, eyepiece optical system (a) and the like use asphericallens (a1) in proximity to a first conjugate surface in relation to aretina in order to reduce a number of lens elements and enhancecharacteristics of marginal telecentricity.

Herein, section (a) of an optical system is eyepiece lens group (a)including a Conic surface and herein, a hyperboloid is used on a surfaceopposite a pupil side of eyepiece lens (a2) in order to suppress coma.Its curvature Z(r) is represented by${Z(r)} = \frac{c \times r^{2}}{1 + \sqrt{\left\{ {1 - {\left( {1 + k} \right) \times c^{2} \times r^{2}}} \right\}}}$where c is curvature, r²=x²+y², k is a Conic coefficient and k<−1 isused.

Aspherical lens (a1) of which one surface is arranged in proximity tothe first conjugate surface in relation to the retina is a saucer-shapedcurved surface lens, wherein curved surface Z(r) of another surfacethereof is a rotationally symmetric quadratic curve and represented by${Z(r)} = {\frac{c \times r^{2}}{\left\{ {1 + \sqrt{1 - {\left( {1 + k} \right) \times c^{2} \times r^{2}}}} \right.} + {A \times r^{4}} + {B \times r^{6}} + {C \times r^{8}} + {D \times r^{10}} + {E \times r^{12}} + {F \times r^{14}} + {G \times r^{16}} + {H \times r^{18}} + {J \times r^{20}}}$where c is curvature, r²=x²+y², A, B, C, D, E, F, G. H, J are asphericalcoefficients (even number order), K is a Conic coefficient and K=−1, asaucer-shaped curved surface of a <−1.0*10 ⁻⁷ is used.

In this case, as the tilt of telecentricity is corrected by at least twoaspherical surfaces so as not to be overly different depending upon theincident angle upon the eyepiece lens, curved surface mirror (c) uses anormal spherical surface mirror. This is to change the tilt oftelecentricity forcibly and arrange the pupil position (position wherelight flux converges) at position (z1) in proximity to an entranceposition of objective lens group (d). Furthermore, as it is possible tointentionally place the pupil position toward an object, an effect thata reduction optical system is easily designed can be obtained.

The reason why the pupil position (position where light flux converges)is arranged at position (z1) in proximity to the entrance position ofobjective lens group (d) is that a focus adjustment corresponding to theeye's lateral brisk movement does not let, as shown in FIG. 38, thefocus position vary that much even with the eye's lateral briskmovement.

Namely, aspherical lens (d1) is inserted into an entrance section ofobjective lens group (d) and with consideration of a positiondisplacement (as shown in FIG. 38, light flux passes through margins ofa pupil surface) at a pupil position accompanied by telecentricity shiftdue to the lateral eye movement, lens d1 has a lens surface of a lowcurvature at an marginal section with respect to a centre and therebylengthens its focus position. Originally, as eyepiece lens group (a) hasa characteristic that a focus point gets close to an eyepiece directionof the eyepiece lens due to the eye's lateral brisk movement, a largechange in a focus plane is suppressed by getting a focus position closerto a position of the liquid crystal display element by aspherical lens(d1).

A surface on the pupil side of aspherical lens (d1) employed herein is ahyperboloid surface and its curved surface Z(r) is represented by${Z(r)} = \frac{c \times r^{2}}{1 + \sqrt{\left\{ {1 - {\left( {1 + k} \right) \times c^{2} \times r^{2}}} \right\}}}$where c is curvature, r²=x²+y², k is a Conic coefficient and k<−1 isused.

However, as obvious from FIG. 38, it can be seen that an image planebecomes oblique with the eye's lateral brisk movement action. Thus, asaspherical lens (d1) cannot completely correct the oblique image withthe hyperboloid surface only, it is desirable that the oblique image becorrected by an aspherical surface Z(r) thereof represented by${Z(r)} = {\frac{c \times r^{2}}{\left\{ {1 + \sqrt{1 - {\left( {1 + k} \right) \times c^{2} \times r^{2}}}} \right.} + {A \times r^{4}} + {B \times r^{6}} + {C \times r^{8}} + {D \times r^{10}} + {E \times r^{12}} + {F \times r^{14}} + {G \times r^{16}} + {H \times r^{18}} + {J \times r^{20}}}$where Z(r) is a rotational symmetric quadratic curve, c is curvature,r²=x²+y², A, B, C, D, E, F, G, H, J are aspherical coefficients (evennumber order).

FIG. 39 is a view to show light flux when seeing an object 50 cm awaywith eyes. It can be seen from FIG. 39 that only a focus position of theliquid display element varies, whereas distortion characteristics and anaberration do not vary that much. Therefore, with an adjustment of aspace between lenses of this objective lens group (d) or a space betweenfinal image plane (f) and objective lens group (d), a focus adjustmentcan be easily made from 50 cm up to infinity.

In this optical design, curved surface mirror (c) is used to change thetilt of telecentricity forcibly and arrange the pupil position (positionwhere light flux converges) in proximity to the entrance position ofobjective lens group (d), but if the hyperboloid lens is used as a firsteyepiece lens of the eyepiece lens group and the rotationally symmetricquadratic curve lens is used as a lens in proximity to a first conjugatesurface when designing eyepiece lens group (a) and relay lens group (b),a faithful second conjugate surface can be obtained at the position ofcurved surface mirror (c), too. In this case, a liquid crystal elementmay be directly arranged at the position of curved surface mirror (c) ora first liquid crystal may be arranged at the position of curved surfacemirror (c) and light flux is directly introduced to objective lens group(d) by reversing the splitter mirror section of this optical system, andthen a second liquid crystal may be arranged via a zoom system (notshown) (Actually, light emitted from the liquid crystal sectionconverges at the pupil position, but, for easy understanding sake, theexplanation is given herein such that infinity light flux is emittedfrom the pupil position and is formed on the surface of the liquidcrystal element).

Furthermore, although a correction of chromatic aberration is nottouched on herein, basically, a system in which a correction is made bycombining a plurality of positive and negative lens elements and lenselements of different refractive indices may be incorporated or liquidcrystal elements of receiving light in a case of a video camera andemitting light in a case of a display are separated into three colors ofR·G·B, and then after the separation, lateral chromatic aberration and Zchromatic difference of distance may be corrected.

A direction of bending a mirror is basically toward upper and lowerdirections where a necessary viewing angle is narrow and thus,practically optical systems (b) and (d) do not contact each other asshown in the diagram. Furthermore, the above-mentioned embodiment citesthe combination of the hyperboloid, the positive lens and the asphericalsaucer-shaped negative mirror or the hyperboloid, the positive lens andthe aspherical saucer-shaped negative lens, but the embodiment is notlimited to these combinations and other combinations can becontemplated.

Next, in reference to FIGS. 40 through 42, the device cited in FIGS. 31and 32 will be more specifically described hereunder. An object ofmaking the device into a floor standing type thereof is to make anobserver not feel a weight of the display optical system. To achievethis, a face movement is sensed by a sensor etc whereby the device is socontrolled as to move in the same way as the face by an actuator, but acost becomes high. Thus, an embodiment hereunder uses a method in whichan actuator is not used as much as possible.

In order for an observer not to feel the weight of the display, it isnecessary that a mechanism work such that no workload is generated atall six degrees of freedom of the face movement. Thus, as shown in FIG.40, magic hand technology (x, y and Θz actuations) is used, elevatortechnology (Z and ηz actuations) in FIG. 41 and centre-of-gravitysupporting technology (Θx and ηy actuations) in FIG. 42 are used.

FIG. 40 shows a mechanism in which cross section CR is configured to becoupled capable of turning around and be extensible like the magic hand.In magic hand section (anti-vibration articular bar) 116, a distanceratio of a distance from support section 115 up to the weight member toa distance from support section 115 up to whole viewing angle display118 is m:n and a moment ratio in a case of the same weight is m:n. As aweight ratio of weight member 117 including a hanging bar to wholeviewing angle display device 118 including the hanging bar is n:m, anactual moment against support section 115 stays constant in relation ofm×n=n×m without relaying on an extension of magic hand section 116.Therefore, when a coupling section of the each cross section CR and arevolving axis of support section 115 get smooth by a ball bearing or anair bearing etc, x, y and Θz actuations become possible with almost noworkload. With this arrangement of this mechanism, it is not necessarythat rigidity of the support section be increased that much and avibration can be suppressed. Also the configuration is easy to avoid arisk like a falling down of the body etc.

In FIG. 41, like an elevator, when a weight ratio of weight member 117to whole viewing angle display device 118 is n:m, a configuration ismade well balanced by way of pulley PU. For example, in a case ofn:m=2:1, pulley PU of a type as shown in FIG. 41 may be used. Thesupport section is configured such that the support section is movableupward and downward by hand and it is possible to set a height roughlydepending on a situation where an observer lies on his/her back, takes aseat or stands on foot. On the other hand, when an observer moves a faceupward and downward with a predetermined posture, whole viewing angledisplay device 118 moves upward and downward by around 2 to 30 cm. Atthis moment, when a revolving axis of pulley section PU gets smooth bythe ball bearing or the air bearing, z actuation becomes possible almostwithout generating any workload.

FIG. 42 shows an example in which revolving axis AX is arranged atcentre of gravity of whole viewing angle display device 118 and axis AXis configured such that there is freedom available for ηx, Θy and Θzactuations no matter where the face moves. (a) is a perspective viewlooking from a front right upper direction (an eyepiece direction) ofthe display device. (b) is an elevation view thereof looking from arear, wherein it is configured capable of revolving by an angle requiredfor an action to turn a head leftward and rightward around universaljoint UZ. (c) shows a state where a head revolves leftward andrightward. Furthermore, (d) is a side view thereof and shows freedomallowance of universal joint UZ when a head moves back and forth.Especially, (d) represents a state where a user lies on his/her back,wherein there is provided a groove required when the user moves its facedownward by 90 degrees to that direction.

Although these respective diagrams 40, 41 and 42 are depictedseparately, a pulley for bending a string of each hinge section (notshown) is devised such that a expansion strength balances a tensionstrength by a way of stringing (way of stringing along the magic hand)so as to put each characteristics into use. Furthermore, as a hangingsection of a string is restricted to only upward and downward actuationswithin the hanging bar by a guide mechanism, swaying of the display andthe weight section like a pendulum is avoided.

In the foregoing embodiment, with respect to the weight ratio of wholeviewing angle display device 118 to weight member 117, a balance is keptby respective distance from support section 115. However, with thisconfiguration, since weight member 117 by itself is off a revolvingcenter, inertia is generated when whole viewing angle display device 118is moved horizontally, so that a sense of an uncomfortable wearingoccurs to a user. Moreover, a hanging string of weight member 117 actslike a pendulum and further there is left a vibration of a lowfrequency.

As a method to solve these problems, whole viewing angle display device118 is supported by a configuration shown in FIG. 50. FIGS. 50 (a) is aside view and (b) is a view looking from an upper direction. It shouldbe noted that the same reference symbols as in FIGS. 40 and 41 are thesame sections, so their explanations are omitted herein. A mechanism ofthis configuration supports hanging string 116 a capable of unreeling bypulley 116 b fixed onto magic hand section 116 and hanging string 116 asupports whole viewing angle display device 118 and weight member 117.

In this configuration, there is provided weight member 117 insidesupport section 115 that is a center of revolving. Thus, even if wholeviewing angle display device 118 revolves/moves around support section115, inertia is not generated due to weight member 117. Thisconfiguration suppresses the abnormal sense of wearing since inertiadoes not occur due to weight member 117 when whole-viewing angle displaydevice 118 moves and its movement is stopped.

In the configuration shown in FIG. 50, there is provide second weightmember 117 a that is lighter than weight member 117 such that its centerof gravity comes in proximity to a center of support section 115 and aworkload is not put on the bearing etc arranged between support section115 and magic hand section 116. This weight is lighter than one ofweight member 117 shown in FIG. 40, so generated inertia is small whenwhole viewing angle display device 118 moves.

In order to further increase stability with a configuration shown inFIG. 51, an installation area of support section 115 is expanded andthere is provided leg section 115 a that extends below a position ofcenter of gravity. Leg section 115 a extends below center of gravity, sostability can be maintained even when the device stands on a floor.FIGS. 51 (a) is a side view and (b) is a view looking from an upperdirection. It should be noted that the same reference symbols as in FIG.50 are the same sections.

In this case, strength against support section 115 is asymmetric, so aworkload is put on a revolving mechanism where support section 115revolves. Therefore, when rigidity is increased by doubling theinstallation area of the ball bearing section and the like and furtherthe installation area is placed beneath a chair or a bed that the useroccupies and the installation area is fixed there, there is no actuatingdevice in a direction opposite the device. Therefore, an advantage in aspace and safety is brought about.

Furthermore, in the whole viewing angle display device of the floorstanding type shown in FIGS. 50 and 51, hanging string 116 a supportswhole viewing angle display device 118 with pulley 116 b fixed inproximity to cross section CR of magic hand section 116. Therefore,hanging string 116 a is always parallel with magic hand section 116 evenwhen magic hand section 116 expands/contracts and strength is notgenerated by expansion/contraction of the magic hand section and thuspresence of the string can not effect that much a lateral movement ofmagic hand section 116 (no workload), so a sense of wearing can getalleviated.

Like the foregoing, mechanics therein is designed so as to suppress thesense of wearing as much as possible, but when weight of whole viewingangle display device 118 is equal to and more than 1 Kg, a slightworkload is inevitably generated due to friction caused by its weightwhen whole viewing angle display device 118 moves. In order to suppressthis, it is desirable that tension of hanging string 116 and a relativeangle of cross section CR of magic hand section 116 be checked andactuator giving actuation power to cross section CR and hanging string116 a at a start-up be provided. Especially, as maximum static frictionis larger than kinetic friction when moving a still object, it is goodto control this friction through a feed-back control in accordance withthe tension of the string and the relative angle of cross section CR.

A specific way in which whole viewing angle display device 118 of thefloor standing type is supported has been described so far. Theconfiguration of device 118 follows a face movement of a user based uponpredetermined conditions, but there is likelihood that it is prone toexternal strength (e.g. earthquake or a tilt of a floor standinginstallation are). That is, when support section 115 itself vibrates dueto outbreak of earthquake, device 118 is largely swung around by inertiaof magic hand section 116 and the body of whole viewing angle displaydevice 118 and thereby it is likely to cause danger in a surroundingarea. In this respect, it becomes necessary that, with incorporation ofan earthquake sensing sensor into the body thereof, an abnormal movementof magic hand section 116 be locked and a revolving direction lockrelease device be provided so as to smoothly dismantle whole viewingangle display device 118 at a contact portion with a face. The tilt of afloor standing portion becomes a workload with respect to a movement ina predetermined direction and this gives a user an uncomfortable sensewhen wearing the display device. To avoid this uncomfortable sense, alevel measuring device for checking whether or not a surface of thedevice is in a horizontal position and a level adjustment device forplacing the device in a horizontal position are built in so that auser's smooth movement can be obtained in all directions.

Also, the head-mounted display or glasses-type display follows a subtlemovement of a face instantaneously, so the sickness in VE is apt todevelop. As the body of the image display device of this invention issupported by a floor and the part of the body thereof is also supportedby a face (includes a head, ear etc) and the body thereof is relativelyheavy, so that the body thereof has the effect that the body does notfollow due to inertia with respect to a subtle movement of a user, butfollows with respect to a big movement thereof only, and thereby thebody thereof has an effect that makes the sickness in VE becomesdifficult to develop. In order to further utilize these effectsefficiently, it is preferable that there be provided a stopper and thelike restricting a movement at movable members such as pulley 116 bholding magic hand section 116 and hanging string 116 c when a usersettles in a predetermined posture.

The display device is fixed at a desired position by this stopper, sothat a situation where the display device does not contact a facecompletely can be provided to a user who feels a sense of wearing evenwith a slight contact with the face and this can be contributed in orderto further offer realism. Especially, in the embodiment shown in FIG. 48to be explained later, not only an image detection area of a retina by acrystal ball's movement corresponding to a eyeball movement but also awide image display area capable of supplying a high quality image evenin a case where a face and the display device relatively move laterallycan be provided, so that an effect becomes further high.

Like the foregoing, the whole viewing angle display device 118 of thefloor standing type has a big advantage in comparison with thehead-mounted display device or the glasses-type display device, so thatthe device 118 produces further an effect with respect to a user whoobserves in a reclining posture before going to bed. In this invention,the display device moves in accordance with a face movement, so this cancreate an atmosphere where a user easily falls asleep by letting theuser enjoy a display image in a relaxing posture before sleep orsupplying an image and music of a high sleep effect to a user difficultto get to sleep.

However, it is likely that the display device would become obtrusivewith respect to a movement like rolling over etc after falling asleep.Thus, in this invention, there is provided a timer in display device118, wherein a power switch will be not only turned off after fallingasleep but also an automatic wind-up system is incorporated therein suchthat hanging string 116 a is automatically wound up and the displaysection is also lift up from a face so as not to be obtrusive to a userin bed. Furthermore, there is provided a function that actuates thedisplay section to a position where it does not become obtrusive when auser gets up by expanding/contracting magic hand 116 after lifting upthe display section.

With this arrangement, a user can use this display device readily evenbefore retiring and then comfort and safety at bedtime can be secured. Asafety precaution just in a case where the display section gets stuck ona part of a face and cannot be lift up is dealt with by restrictinglifting strength and the like.

The arrangement as described above projects an image output from LCD onthe retina inside at least one of the eyeball by way of the fisheye-typeoptical system, but it can be seen that the optical system in responseto the lateral brisk eyeball movement can project the image withoutvignetting at the pupil with combination of the curved surface mirrorand the aspherical lens. However, a focus is fine and distortion is fewat the center part viewed by the laterally moving eyeball, whereasdistortion and a focus state get deteriorated sharply in proximity tothe center part.

Therefore, in a following embodiment, as described in each embodimentshown in FIGS. 20, 23, 28, 35 through 39, using what the intermediateimage is formed on a side of the liquid crystal two-dimensional displaydevice (opposite the eyeball), the embodiment is configured to becapable of dealing with the lateral brisk eyeball movement, too byinserting a diffusion glass to a position of forming the intermediateimage. FIG. 43 is a view explaining this configuration and shows anexample of an optical system that lessens curvature of field on animage-forming surface and a tilt of telecentricity around a diffusionglass by way of a hyperboloid lens. An image output converges at acrystal ball of eyeball 1 via diffusion glass 131 and eyepiece lensgroup 132. (a) of FIG. 43 is a case where the eyeball does not movelaterally and (b) thereof shows a laterally moving eyeball of 30degrees. In this example, the nearest lens to eyeball 1 is hyperboloidlens 132 a. The hyperboloid lens is a lens of which one-side surface ismade of hyperboloid and as shown in the diagram, a far surface fromeyeball 1 is hyperboloid.

Optical characteristics are shown in FIG. 44. FIG. 44 (a) is an examplewhere a pupil views a center and FIG. 45 (a) shows aberrations on thisoccasion. Eyepiece lens system 132 is a fisheye-type optical system thatmakes telecentricity almost straight. Namely, eyepiece lens system 132is designed such that principal ray of light of each light flux at aposition where diffusion glass 131 is inserted is almost parallel toeach other (allowable for a tilt of an order of ±10 degrees) and isalmost parallel to a normal line of an incidence surface of diffusionglass 131, so that the eyepiece lens system 132 produces the samedistortion as in the fisheye-type optical system. Thus, distortion ofaround 50% is produced at an viewing angle of ±60 degrees. FIG. 44 (b)shows an example where a pupil faces in a 30-degree direction, whereinFIG. 45 (b) shows aberrations on this occasion.

When compared with telecentricity of FIG. 44 (a), it can be seen thattelecentricity is tilted by an order of 10 degrees. That is, principalray of light of each light flux is tilted by the order of 10 degrees incomparison with a case (a) where crystal ball 2 faces in a 0-degreedirection. Next, FIG. 44 (c) shows a case where a user views an objectat 50 cm ahead, not infinity, wherein FIG. 45 (c) shows aberrations onthis occasion. In this case, eyepiece lens section 132 is designed suchthat a focus position does not come into eyepiece lens section 132.However, as seen from FIGS. 45 (b) and (c), a shift in distortion issmall even when comparing with FIG. 45 (a) and it can be seen that afaithful image can be obtained throughout an entire field of ±60 degreeswhen a screen and the like is arranged at the position of forming animage.

In a case where this eyepiece optical system is used, a method of usingdiffusion glass 131 will be described hereunder. An example where apupil views a center is shown in FIG. 43 (a), whereas FIG. 43 (b)represents a case where the pupil faces toward a 30-degree direction. Asseen from comparison of (a) with (b), a shift in distortion is small,but it can be seen that telecentricity is titled by ±10 degrees atmaximum as described above. When making the fisheye-type optical systemcorresponding to this lateral shift (lateral eyeball movement), it isknown that distortion is slightly produced in an optical system that canproject without vignetting at the pupil like the foregoing embodiment.

Therefore, as remedial measures, an optical system from the liquidcrystal two-dimensional output device to diffusion glass 131 is designedwith N.A. (stands for numerical aperture) that enables to obtain asufficient resolution of an image and adopts a method in which lightflux corresponding to a change in the tilt of telecentricity istransmitted to a pupil by diffusing the light flux with diffusion glass131. That is, the optical system causes to diffuse ray of light at theangle of divergence as shown by arrow 133 of FIG. 43 with diffusionglass 131 such that ray of light entering crystal ball 2 exists evenwhen a tilt of crystal ball 2 varies.

Like this, it is designed such that, at the intermediate image formed bylight flux transmitted to the crystal ball from the image formed by thetwo-dimensional optoelectric device the optical system, the angle ofdivergence of light flux of each position emitting from the intermediateimage becomes sufficiently large by way of the diffusion glass.

As described above, with a change in the pupil position due to thelateral shift of the crystal ball (an action of a lateral brisk eyeballmovement), an angle formed by all principal rays passing through thecenter of the pupil and the surface of forming the intermediate varies.Thus, the angle of divergence of light flux emitted from theintermediate image is made equal to or larger than the amount ofvariation. With this arrangement, even if the lateral shift of thecrystal ball takes place, light flux from the intermediate image can besupplied to the pupil stably and even when the lateral shift of thecrystal ball (action of the lateral brisk eyeball movement) occurs, thetwo-dimensional display device that a user can observe a faithful imagecan be obtained.

Herein, it is good to use a diffusion glass that has field of view of±30 degrees and an angle of diffusion of ±10 degrees or so and whoseroughness is not discernible even with a human eye, namely, a glassequivalent to an angle of diffusion A of roughness #700 and over interms of ground glass.

Naturally, it is desirable that a material whose luminous intensitydistribution does not overly vary at around ±20 degrees be used since anangle of the laterally brisk moving eyeball is said to be around ±50degrees. Diffusion glass 131 is arranged at the position of forming theimage as described above and acts to diffuse beam of light that formsthe image, so a resin and the like can be used instead of diffusionglass 131 if it has the action of diffusing beam of light.

Also, diffusion glass 131 that will be fabricated hereunder exerts afavorable performance, too. A way of fabricating this diffusion glass isthat adhesive is applied over a polyester film of a uniform thicknessand a smooth surface and then abrasive whose diameter is preciselycontrolled in a micron grade is coated thereon in a clean room. As forabrasive, carbide and oxide such as silicon carbide, chromic oxide, tinoxide, titanium oxide, magnesium oxide, aluminum oxide and the like aresuitable and diffusion glass 131 can be fabricated with a uniformultra-precise finishing of an order of 0.3 to 40 μm and a yield ratiobecomes small.

An image become opaque when these materials are processed spherically,but uniform abrasive can be layered in a random order with apredetermined thickness, and the angle of divergence can be made largeso that an viewing angle of 60 degrees and over can be secured withoutyielding graininess at all even in a DVD image or a HD image. Thisdiffusion glass 131 is preferable in terms of a low production cost.Furthermore, it is preferable that a thickness of this abrasive layer bewithin depth of focus of a projection image.

Well, a size of abrasive is selectable from mesh number #320-#15000 anda strong polyester film is used, so that durability is enhanced. Insilicon carbide, chromic oxide, tin oxide, titanium oxide, magnesiumoxide, aluminum oxide and the like, when abrasive of an order of micronis used, the image becomes opaque. In this case, it is necessary thatprojection illumination to diffusion glass 131 be intensified. But, whenthe display device is of the floor standing type, high-powered lightsource can be used, so that a light source of a desired power can beused in correspondence to transparency of diffusion glass 131.

Furthermore, as the light source itself is bright, brightness of aprojection image becomes quite bright and side effects like stray light,hot spot and like are reduced even without wearing a light shade device(goggle etc) between the eyepiece lens and both eyes so thatdeterioration of the sense of wearing can be avoided. However, the lightsource in itself is a heat source too, so it is necessary that a coolingfun and the like cooling the heat source be incorporated into thedevice. As a user feels uncomfortable if advent of the cooling fundirects at the user, it is necessary that a vent direction of thecooling fun be designed not to direct at the user. Also, when thecooling fun vibrates the device, this vibration also gives a user anuncomfortable feeling. In this case, the light source may be arranged ona side of a floor support section by separating the light source fromthe body of the device and thus light flux may be guided to the devicevia an optical fiber and the like.

In reference to FIGS. 46 and 47, an explanation about an optical systemthat relays light flux from the liquid crystal two-dimensional outputdevice to diffusion glass 131 will be given. FIG. 46 shows an opticalsystem where light flux coming from a surface where high resolutionthree-piece SXGA liquid crystal element 101 exists or is conjugatesurface (f) in relation to the surface passes through half mirror HM viazoom automatic focus control system (g) and objective lens group (d) andis reflected by half mirror HM after distortion produced by the eyepiecelens system is corrected by reflection on curved surface mirror (c), andis formed on LCD conjugate surface 141 (where diffusion glass 131 isarranged) via relay lens group (b) by reflecting. Distortioncharacteristics of this optical system is shown in the diagram, but itcan be seen that 50% of distortion occurs in a direction opposite thedirection shown in FIG. 45 (a) when comparing with FIG. 45 (a). Thisrepresents that reverse correction of the foregoing distortion isachieved by this optical system, wherein pincushion distortion producedby the eyepiece lens system is corrected by barrel distortion of thisoptical system and a grid image is faithfully reproduced on the retinawithout correction by a software application.

FIG. 47 is an example of an enlargement optical system designed on theassumption that distortion is corrected by a software application andthis enlargement optical system does not include the curved surfacemirror as shown in FIG. 46. In this enlargement optical system, lightflux from a surface where high resolution three-piece SXGA liquidcrystal element 101 exists or is conjugate surface (f) in relation tothe surface passes through achromatic lens (h) via zoom automatic focuscontrol system (g) and objective lens group (d) and is reflected twiceby reflection mirrors M3 and M4 via relay lens group (b) after the lightflux is reflected by reflection mirrors M1 and M2, and then is formed onLCD conjugate surface 141 (where diffusion glass 131 is arranged). Inorder to reduce a number of lens elements and lessen curvature of field,a hyperboloidal lens (one surface of a lens is hyperboloid) is includedin an eyepiece lens system (not shown) and relay lens system (b).Aberration of this optical system is so small that a faithful projectionimage can be achieved. It should be noted that achromatic lens (h) isnot necessarily used.

Like this, this embodiment adopts the optical system that can deal withthe lateral brisk moving eyeball by inserting the diffusion glass to theimage plane in proximity to the eyepiece lens and with this system, aconfiguration of the enlargement optical system after the eyepiece lenscan be made simple.

As the liquid crystal two-dimensional output device, FIG. 48 shows aschematic view of a device embodied by this invention using the opticalsystem of FIGS. 44 (a) and 47.

According to FIG. 48, GRB three-piece LCD module 142 is used and a LCDelement for G, a LCD element for R and a LCD element for B are made samelight flux (is referred to as LCD conjugate surface f in the diagram) bya dichroic mirror, and the light flux is deflected by reflection mirrorsM1 and M2 via zoom automatic focus control system (g) of a four-elementlens of positive 1, negative 1, positive 2 and negative 2, and isenlarged/projected on diffusion glass 131 via relay lens (b) andreflection mirrors M3 and M4. Herein, a lens surface of positive 1doubling the eyepiece lens is a hyperboloidal lens and a surface of anobjective lens is also a hyperboloidal lens, so that the number of thelens elements is reduced and curvature of field is corrected.

Light flux diffused at an order of ±20 degrees by diffusion glass 131 isconfigured to project an image from the LCD element on the retina insideat least one of eyeballs via eyepiece lens 132. Herein, when infinity isviewed, diffusion glass 131 lies distant from the eyepiece lens and iscontrolled such that LCD element conjugate surface (f) and a surface ofdiffusion glass 131 become in conjugate relation to one another bymoving two negative lenses in the zoom automatic focus control system(g). Also, in a case where an object at 50 cm ahead is viewed, diffusionglass 131 is controlled such that diffusion glass 131 is actuated so asto get close to the eyepiece lens and, at a position of actuateddiffusion glass 131, LCD element conjugate surface (f) and the surfaceof diffusion glass 131 become in conjugate relation to one another bymoving two negative lenses in zoom automatic focus control system (g).

On the other hand, the image from the LCD element is broadened to fieldof view of ±60 degrees under the foregoing situations and there would beno problem if an image from the video of a wide image capable ofreceiving the field of view of ±60 degrees is reproduced. But, if ausual video signal or computer image is output, such the broadened imageis not certainly eye-friendly. That is, it is desirable that an image offield of view with ±30 degrees and below comfortable to see with a usuallateral moving eyeball be output. Thus, according to this invention,field of view can be reduced down to field of view with ±30 degrees andbelow by moving two negative lenses in zoom automatic focus controlsystem (g). Furthermore, in a case where a number of pixelscorresponding to content is an order of 760×400 (TV and DVD), an imageis reduced to field of view with an order of ±15 degrees and in a caseof an order of 1280×800 (BS and a motion image output from large amountof pixels), an image is reduced to field of view with an order of ±30degrees. Reduction of the image permits to yield a clear image with nodiscernible pixel.

Like the foregoing, with enlargement/reduction by way of the zoomsystem, a screen size corresponding to a number of pixels can beselected at will and all contents can be dealt with.

Furthermore, the zoom system helps improve the sickness in VE, too.Usual content is not supposed to be output as a wide field-of-viewimage, so there are many cases where, for an image effect purpose,pictures are taken while pointing a video camera at various directionsor a zoom is overused, not fixing the video camera in use at a specificposition. There is not any problem at all with a display deviceequivalent to a TV image of a regular 10-50 inches, but it is likelythat a screen of 60 degrees and over (equivalent to 100 inches) causes aself movement perception syndrome (an illusion as if he/she moves aroundis created and affects a sense of balance. A picture image that feedsinformation to field of view of a wide range affects the sense ofbalance and a mismatch between visual information and somatosensoryinformation due to the picture image can provoke discomfort and afeeling of illness or sickness.)

But, a wide field-of-view image at infinity of 60 degrees and over of alandscape or distance captured by a fixed camera is close to a realimage and is realism-packed, and yields a parallax-free naturalthree-dimensional sense, so that the wide field-of-view image is veryeffective in relaxation or to heal eyestrain. Therefore, as the imagedisplay device of this invention, the device is adjusted by the zoomsystem corresponding to not only a resolution of content but alsocontent of an image and thereby information of a pleasing image can beobtained. Thus, it is desirable that the zoom system include a zoomsystem of about 2× and over covering from the wide field-of-view imageat infinity of 60 degrees and over (equivalent to 100 inches) to animage of 30 degrees and below (equivalent to 50 inches) hard to causethe self movement perception.

It is needless to say that this optical system is applicable to thetwo-pair system employed as the twin-optical system as describedpreviously.

When the twin-optical system is adopted, GRB three-piece LCD module 142may be arranged respectively for each optical system, but GRBthree-piece LCD module 142 may be used as a common module for right andleft eyes. In this case, this can be achieved by splitting light fluxemitted from GRB three-piece LCD module 142 into a plurality of lightflux with a splitting optical element and distributing split flux toeach optical system for the right and left eyes. Well, as an imagereflected by the half mirror or the polarized beam splitter has itsright and left reversed, in this case, it is good to reflect reflectedlight flux again and arrange a reflection optical element letting thelight flux enter one of the twin-optical systems in an optical path. Itis preferable that an optical system be configured so as to form theintermediate image on LCD conjugate surface (f) temporarily in order torelay an image from GRB three-piece LCD module 142 to the optical systemas shown in FIG. 48 after splitting light flux.

In the image display device of the embodiment of this invention asdescribed above, the image display device has the optoelectric elementthat outputs image data and projects an output image output from theoptoelectric element on a retina of an eyeball via at least tworeflection surfaces of the curved surface, the first reflection surfaceof the curved surface deflecting flux before entering an eyeball is thefirst elliptic mirror of which the first focus point is in proximity toa crystal ball of an eyeball and the second focus point of the firstelliptic mirror is configured so as to exist between the first ellipticmirror and the second reflection surface of the curved surface, so thata wide field-of-view image can be transmitted to an eyeball efficiently.

Furthermore, when the second reflection surface of the curved surface isthe second elliptic mirror and an image on the optoelectric element isprojected on the retina of the eyeball with a correction optical systemincluding the second elliptic mirror, large distortion can be correctedand a faithful display image can be viewed.

Let a reflection surface be the second elliptic mirror, and the secondfocus point of the first elliptic mirror and the first focus point ofthe second elliptic mirror are made substantially in alignment, and thefirst and second focus points of the first elliptic mirror and the firstand second focus points of the second elliptic mirror are arranged so asto line substantially in a straight line. With this arrangement, imageinformation having the wide field-of-view to be projected to the firstfocus point from the second focus point of the second elliptic mirror isprojected to the first focus point from the second focus point of thefirst elliptic mirror and a second focus image of the second ellipticmirror can be exactly reproduced at a portion of the first focus pointof the first elliptic mirror. Furthermore, it becomes possible to obtaina much more faithful image if curvatures of the first and secondelliptic mirrors are made substantially equal.

Furthermore, it is preferable that a flat surface passing through acenter of a line linking the first and second focus points of the firstelliptic mirror and being orthogonal to the line and the reflectionsurface deflecting light flux of the first elliptic mirror be configuredto intersect, and a flat surface passing through a center of a linelinking the first and second focus points of the second elliptic mirrorand being orthogonal to the line and the reflection surface deflectinglight flux of the second elliptic mirror be configured to intersect, tooand a fisheye-type optical system be arranged between the secondelliptic mirror and the optoelectric element and an image on theoptoelectric element be caused to be projected on the retina inside atleast one of the eyeballs. With this arrangement, a flat surface imageon the optoelectric element can be converted to a wide image with thefisheye-type optical system in a reverse to what the fisheye-typeoptical system projects the wide image on means for receiving light witha flat surface and also information of the wide image is enabled to beformed on the retina inside at least one of the eyeballs withoutdistortion by way of the elliptic mirror of a wide reflection surfacesuch that the wide reflection surface intersects with the orthogonalflat surface passing through centers of each focus points. To get atotal 120 degrees of 60 degrees as a fixed viewing angle and respective30 degrees of an viewing angle for the right and left eyes correspondingto the laterally moving eyeball, a configuration in such a way that theorthogonal flat surface passing through the center of the line linkingthe first and second focus points intersects with the reflection surfacedeflecting light flux of each elliptic mirror is requisite.

Also, in the fisheye-type optical system, as the image on theoptoelectric element is configured to be projected on the retina insideat least one of the eyeballs without vignetting overly by supplyinglight flux including image data to an image detection area of the retinadue to a crystal ball movement corresponding to a turn of the eyeball, asufficient field of view can be provided even when the eyeball moveslaterally in order for the eye to broaden field of view as shown in FIG.5. This lateral eyeball movement is a very important evasive actionagainst tiredness being felt when the human eyes continuously performs asingle action and then a function of the eye is getting unable to followgradually, and the embodiment of this invention that provides a field ofview when the evasive action of the lateral eyeball movement startsplays an important role in order not to cause a user tiredness.

As for its method, in order to reduce an out-of-focus area produced byspherical aberration, an aperture in proximity to the pupil is madesmall and thereby the first fisheye-type optical system projects animage on a first element of receiving light with small N.A. The secondfisheye-type optical system, on the other hand, uses distortioncharacteristics similar to those of the first fisheye-type opticalsystem, but the aperture in proximity to the pupil is made large incomparison with the one of the first fisheye-type optical system. Thisarrangement provides a sufficient field of view even when the eyeballmoves laterally for broadening the field of view. This is configuredsuch that light flux can reach the crystal ball at the time of theeyeball lateral movement because the crystal ball of the human eye actsas the small aperture.

The embodiment of this invention enables to provide variousconfigurations such that the image display device is arranged to atleast one of the right and left eyes or an arrangement position isadjustable corresponding to a space between eyeballs by arranging thedisplay device separately to the right and left eyes, so that a varietyof utilization corresponding to usage is conceivable.

Furthermore, the optoelectric element that adopts the liquid crystaldisplay device of emitting light in a two-dimensional way perpendicularto a direction of light flux enables to provide image information morefaithful to a real field of view with a precise resolution and lowenergy consumption. The optoelectric element of this invention is notlimited to this embodiment and when an optoelectric element is anelement of emitting light in a two-dimensional way, every otheroptoelectric element is usable.

In another embodiment of this invention different from the foregoingembodiment, there is provided a first fisheye-type optical system toproject a predetermined wide image on a first optoelectric element ofreceiving light in a two-dimensional way perpendicular to a direction oflight flux and image data received by the first optoelectric element ofreceiving light in a two-dimensional way is output from a secondoptoelectric element of emitting light in a two-dimensional wayperpendicular to the direction of light flux and the image output fromthe second optoelectric element is caused to be projected on the retinavia s second fisheye-type optical system and a reflection surface with ashape of a curved surface.

In this embodiment, as the fisheye-type optical system projects a wideimage on the element of receiving light with a flat surface, the firstoptoelectric element of receiving light in the two-dimensional waycaptures the image as image information, and the image information isoutput from the second optoelectric element of emitting light in thetwo-dimensional way and then a flat image on the optoelectric element isconverted to a wide image through a reverse correction by reverselyusing a fisheye-type optical system of the same characteristics thistime. That is, these fisheye-type optical systems may form a flat imagewhile producing large distortion and distortion of the flat image iscompletely corrected at an exiting section of the second fisheye-typeoptical system, and the flat image can be made into a faithful wideimage.

And there is production error among the first and second optoelectricelements or among the first and second fisheye-type optical systems orwhen a device/element of a different performance is used, it can be saidthat distortion is present to some degree. In such the case, morefaithful image information can be obtained by controlling so as todigitally correct the image information captured by the firstoptoelectric element based upon the distortion error and output theimage information from the second optoelectric element.

Furthermore, it is preferable that the reflection surface with a shapeof the curved surface be formed by an elliptic mirror of at least twosurfaces and one of two respective focus points of the two ellipticmirrors be arranged substantially at the same position as that ofanother of respective two focus points and thereby all focus points bearranged to line substantially in a straight line. A reason of this isnot to distort an image until the image is projected on the retina ofthe eyeball even when image information emitted from the secondfisheye-type optical system completely restores information of the wideimage by the foregoing method. Distortion of image information projectedfrom the second focus point to the first focus point of the secondelliptic mirror is completely restored by tracing back the same opticalpath during the image information is projected from the second focuspoint to the first focus point of the first elliptic mirror. Therefore,it becomes possible to completely restore the second focus-point imageof the second elliptic mirror at a portion of the first focus point ofthe first elliptic mirror. Furthermore, when curvatures of the first andsecond elliptic mirrors are made approximately equal, a more perfectprojection image can be obtainable.

It is preferable that a pair of the image display device be arranged forthe right and left eyes and a space between a pair of the firstfisheye-type optical systems and a space between eyeballs be arranged soas to be equal, and a space between both of the image display device bemade adjustable so as to be in agreement with a space between left andright eyes. This arrangement is effective to obtain a three-dimensionalimage faithful to a real image with the same field of view created bymaking a space between input sections of image information equal to aspace between both eyes. Also, a more powerful three-dimensional imagecan be obtained with an intentional change of this space. This becomeseffective when this image display device is used in a video game and thelike.

As for another example, the reflection surface with the curved surfaceis formed of at least two fθ-type mirrors and a focus point of one ofthe fθ-type mirrors is arranged in proximity to the crystal ball of theeyeball, and another focus point thereof is arranged in proximity to thesecond fisheye-type optical system. With this arrangement, the secondfisheye-type optical system and the second optoelectric element areprevented from protruding in a case where the foregoing elliptic mirroris used and the image display device is configured to extend toward theear as the wearable unit. But, with this arrangement, field of view onouter edges is likely to get vignetted and thus it is preferable thatthis arrangement be subject to change depending upon usage.

Furthermore, it is preferable that the second fisheye-type opticalsystem be configured such that the image on the optoelectric element isprojected on the retina inside at least one of the eyeballs withoutvignetting the image overly by supplying light flux including image datato the image detection area of the retina due to the crystal ballmovement corresponding to the turn of the eyeball. This configurationenables to provide a sufficient field of view even when the eyeball islaterally moving for broadening field of view as described above (pleaserefer to FIG. 5). This lateral brisk eyeball movement is a veryimportant action in an evasive action to tiredness being felt when thehuman eye performs a single action continuously and the function ofhuman eyes is getting unable to follow gradually, and the embodiment ofthis invention that provides a field of view at the start-up the evasiveaction of the swift moving eyeball plays an important role in order notto cause a user tiredness. And, a reason why the image display device isconfigured to be arranged to at least one of the right and left eyes ora arrangement position is configured to be adjustable corresponding to aspace between eyeballs by arranging the image display device separatelywith respect to the right and left eyes is that a variety of utilizationcorresponding to various uses is conceivable. Furthermore, a reason whythe optoelectric element adopts the liquid crystal display device ofemitting light in the two-dimensional way perpendicular to the directionof light flux and the first optoelectric element incorporates the CCDarray sensor of receiving light in the two-dimensional way perpendicularto the direction of light flux is that image information more faithfulto a real field of view can be provided with a precise resolution andlow energy consumption. Certainly, this invention is not limited to thisembodiment and when an optoelectric element is a type of emitting lightin the two-dimensional way and receiving light, every other optoelectricelement is applicable. In this specifications and its claims, aso-called type of emitting light refers to everything including a liquidcrystal display (LCD) using a Halogen lamp and LED (light emittingdiode) as a back light even if the LCD does not emit light by itself anda reflection-type liquid crystal display (LCOS) inclusive of a liquidcrystal display having the diffusion glass arranged on its back andemitting light by way of ambient light.

Furthermore, in another embodiment different from the foregoingembodiment, a predetermined wide image is projected on the firstoptoelectric element of a spherical surface for receiving light in thetwo-dimensional way perpendicular to a direction of light flux and imagedata received by the first optoelectric element of receiving light isoutput from the second optoelectric element of a spherical surface foremitting light in the two-dimensional way perpendicular to the directionof light flux and the image output from the second optoelectric elementis caused to be projected on the retina via the reflection surface withthe curved surface. Moreover, the first optoelectric element has anopening on its spherical surface, wherein a positive lens is arranged atthe opening section and a plurality of CCD two-dimensional array sensorsare arranged on an inside wall of the spherical surface, and the secondoptoelectric element has an opening on the spherical surface, wherein apositive lens is configured to be arranged on the opening section and aplurality of liquid crystal devices are configured to be arranged on aninside wall of the spherical surface. With this arrangement, imageinformation of a wide image can be sent directly to the retina inside atleast one of eyeballs without converting the wide image to flat imageinformation.

Furthermore, in another embodiment different from the foregoingembodiment, another embodiment includes a first fisheye-type opticalsystem that projects a predetermined wide image on the firstoptoelectric element of receiving light in the two-dimensional wayperpendicular to a direction of light flux, and a control system thatoutputs image data received by the first optoelectric element ofreceiving light from a second optoelectric element of emitting light ina two-dimensional way perpendicular to the direction of light flux andimplements a desired control when projecting the output image outputfrom the second optoelectric element on a retina inside at least one ofeyeballs via a second fisheye-type optical system. With thisarrangement, a view can be secured by viewing the wide image digitallyand this embodiment has no inconvenience that a conventional imagedisplay device wearing on both eyes blocks the view completely.

Furthermore, in another embodiment, another embodiment is configured toinclude the control system that implements the desired control whenprojecting the predetermined wide image on the retina inside the eyeballso as to include at least one of a focus adjustment system for focusingon the predetermined wide image or a control system for controlling anoutput area of the wide image at will. With this configuration, thisinvention permits a user usually wearing glasses to view imageinformation without glasses. Moreover, a necessary part of informationof the wide image can be viewed as a wide image by digitally enlargingthe necessary part only and thereby this acts as a magnifier for a userwith poor eyesight. Furthermore, as for an observer that views anordinal image distortedly due to an eye disease, a normal image can beprovided by correcting an output image in correspondence to thedistortion.

Furthermore, when the control system is configured to include an imagecomposite function that composite first image information input from anexternal rather than the image display device with second imageinformation input from the first optoelectric element and outputs acomposite image from the second optoelectric element, a high-visionscreen of a wide screen, a video image thereof, a DVD image thereof, apersonal computer display screen thereof and the like can be displayedanywhere as needed while viewing the wide image. Moreover, as the wideimage can be displayed, if a screen of a newspaper size or a magazinesize is composited, a virtual newspaper and magazine floating in an aircan be read while paying attention to surroundings.

The first image information is configured to be corrected in such a waythat the image is similarly distorted based upon information ofdistortion produced by the first fisheye-type optical system and becomposited with the second image information, and output. According tothis configuration, as shown in FIG. 12, let (a) be any wide image 200and (b) be external image information 201, an image to be output fromthe second optoelectric element includes information distortion producedby the first fisheye-type optical system and as shown in (c), imageinformation is compressed on edges. Then, external image information 201is composited with reverse correction on the viewing condition by way ofthe first fisheye-type optical system as shown in (c) and information ofa faithful image is provided by restoring the information as aprojection image with no distortion like an image of (d) on the retinaof then eyeball.

Moreover, a video image input device that supplies one of the firstimage information as the video image output information is fixed ontothe image display device and is configured to be detachable as needed.With this configuration, the image display device of this invention canbe used in place of the conventional video camera. With the conventionalvideo camera, a target object or a target subject person can be viewedonly through an image display panel of the video camera or an opticalviewfinder system. Thus, the target is lost sight of at boosting themagnification of the video camera or it is difficult to anticipate whenan obstacle blocks the subject.

However, according to the embodiment of this invention, as shown in FIG.11, by attaching the video camera on a side of the image display deviceof this invention, both of the image of the wide image and the compositeimage can be viewed on the same screen by compositing a part of imageinformation of the video camera and a part of the image of the wideimage while viewing the image of the wide image inclusive of the object.Furthermore, an obstacle and the like can be checked with imageinformation of the wide image and the video camera can be detached fromthe image display device such that the image display device is notblocked, and then an enlargement image can be shot at a position wherethere is no obstacle or at a time of people congestion, an image at anylocation can be surely captured by raising a hand-held video cameraonly. Of course, the control system can change a proportion of the imageof the wide image and the image from the video camera at will and, bystoring image information of both images as image data, the proportionthereof can be changed at will when playing back the image data.

Furthermore, one of the first image information is made into imageinformation output from a computer and another is made into informationinput into a computer keyboard. These are used as shown in FIG. 13, buta composite of image information is described in FIG. 14. In FIG. 14, itis necessary to display a composite portion by compositing processingportion 203 requiring a high resolution of a computer as shown in (c),tool bar portion 204 displayed on edges on a computer screen as shown in(a) and portion 205 displaying information input into the keyboard asshown in (d) into wide image 200 as shown in (b).

As described above, the image output from the second optoelectricelement includes distortion produced by the first fisheye-type opticalsystem and as shown in (e), its image information is compressed at edgeportions. Thus, external image information 204 and 205 are converted insuch a way that a reverse correction is performed on distortion producedby the second fisheye-type optical system as shown in (e) and bycompositing the converted image information with wide image 200, theimage output from the second optoelectric element provides informationof a faithful image that is restored as a distortion-free projectionimage like an image of (f) on the retina of the eyeball.

Furthermore, the first image information is information input into aportable keyboard by a hand and the information input the portablekeyboard is made into image information by detecting information of anelectromagnetic element attached at a thumb with an electromagneticdetection sensor and converting the information into information ofdistance/direction of the thumb and another fingers and the imageinformation representing a hand movement can be displayed at portion (d)of FIG. 14 as it is. In portion (d), an image of a virtual keyboard isdisplayed and when the thumb is fixed at any position and anotherfingers move at any position, this information is converted intotwo-dimensional location information inclusive of up/down/right/leftdirections including the distance and direction and as imageinformation, each finger moves on the virtual keyboard and a key on thekeyboard is lit up. Thus, with this arrangement, it becomes possible toselect a key on the keyboard correctly while checking an image.

The information input into the portable keyboard is made into the imageinformation by detecting information of a finger pressure of each fingeragainst an object with a pressure detection sensor arranged at eachfinger and converting the information of the finger pressure of eachfinger as recognizable image information, so it can be checked whetheror not the lit-up key is typed or whether or not data is correctlyinputted as image information, for example, by changing a lit-up colorand the like.

Herein, as an example, a display method of using the lit-up key or viachanging color is introduced, but this invention is not limited to thisembodiment, but is applicable to a wide variety of applications.

Furthermore, one of the first image information is configured to beimage information by converting a voice sound or a non-voice sound inputfrom a microphone or a headphone into a character. This is because thecontrol system has a function that converts the sound into textinformation. Especially, when both ears are blocked by the headphone andthe like, a noise becomes small and as the control system can converteven the non-voice sound into the sound voice by vibrating a vibrationpaper of the headphone, even if information is input just in a whisper,the information can be converted into the image information as the textinformation. Moreover, when the image display device includes a mailfunction/telephone function in the personal computer, the textinformation can be input and the information can be transmitted at ahigh speed.

As for another configuration, the second optoelectric element and thesecond fisheye-type optical system are configured to be arrangedseparately with regard to right and left eyeballs whereas the firstoptoelectric element and the first fisheye-type optical system areconfigured to be in common with right and left eyeballs and a positionof information input into the first optoelectric element is converted incorrespondence to width of both eyeballs and then, the information isconfigured to be output as separate information in correspondence to thesecond optoelectric element of the right and left eyeballs. As shown inFIG. 10, field of view seen with both eyes is different in field-of-viewarea by a degree at which the eyes are apart from one another. If theinformation of the first optoelectric element in common is given to 6Land 6R of the second optoelectric elements (the liquid crystaltwo-dimensional output device) for right and left eyes withoutcorrecting the information, an image looks dual. In order to displaythis dual image as a single image, a faithful projection image can beobtained by way of the foregoing method.

Like the foregoing, this invention can capture the wide image as imageinformation and thus can provide a full-fledged wearable informationinput/output device exceeding the conventional wearable image displaydevice or wearable computer with conceivable various combinations usingthe captured wide image. Moreover, this invention enables sales of atuned-in video game software, a wide image high-vision image, wide imageDVD and wide image video cassette tape that effectively use the image ofthe wide image and furthermore, a full-fledged system of a genuinevirtual reality can be provided.

Also, in order to provide the foregoing products, image informationinput device 35, three-dimensional image input device 36, highmagnification image input device 37 and the like as shown in FIG. 15 aredetached from this image display device and re-combination thereof canlead to diversification of usage and utilization, and let the foregoinginput devices be an Infrared, violet and nuclear radiation detectiondevices, this invention can further develop into usage at a nighttime orhazard areas, too.

This invention can provide the image display device as a system freefrom sense of discomfort produced by a weight and wearing with directattachment of this image display device to a seat in a movie theater oraircraft, a chair for relaxation, a bed for caring a bed-ridden seniorand the like, not to mention a supporting method of a glasses-type imagedisplay device and a head-mounted image display device.

A more specific method of releasing the sense of discomfort due to theweight and wearing other than the foregoing provides a supporting standthat independently supports the image display device and arranges theimage display device at a front end of an arm member having athree-dimensionally movable articular structure. The arm member has aweight member in a direction opposite the image display device at acentre of the supporting stand, so that the weight of the image displaydevice can be cancelled out. Furthermore, a light-tight cover of afabric material that blocks a light leakage from an external is providedon the image display device and forming of a negative pressure insidethe cover (a slight pressure against an external pressure) furtherenables to provide a comfortable structure that follows a face movement,but does not give a user any sense of a weight and causes the user toforget a sense of wearing by softly fitting across the face. Adoption ofthis structure enables to circulate an air inside a wearing section andprevent moisture inside. If the cover completely blocks the light fromthe external, however, it becomes difficult to eat, drink etc whilewearing this image display device. Thus, it is preferable thatinformation of the external be able to be obtained from a lowerdirection of the image display device. When the lower portion thereof iskept open, but, it is likely that clearness of an image is lost due to aray of light leaked from the lower portion thereof.

Then, the amount of the light leakage from the external is suppressed byproviding a filter that has almost no effect on clearness of the imagedisplay device in this lower portion and the inside negative pressure iskept and a way for obtaining external information is devised, and withthe foregoing, a more comfortable system can be provided.

Moreover, as for a device of this invention to input the externalinformation, regardless of a wire or wireless, any device is usable toall usage.

In the embodiments of this invention, it is assumed that the reflectionsurface with the curved surface is something like a reflection surfacecoated by a metal film. An internal surface of a transparent glassmember or a plastic member may be used as the reflection surface, but itis not preferable to use a member of an optical refracting power as thereflection surface with the curved surface because the member of theoptical refracting power causes a color dispersion at an entranceposition and an exit position from an air. However, when two reflectionsurfaces of the same curved surface are used symmetrically with respectto a line or a point, even the color dispersion can be corrected if theentrance and exit positions from the air are arranged at the symmetricpositions. As a refractive index of the transparent glass member orplastic member is larger than that of an air, incident light flux at alarge angle reaches the reflection surface of the curved surface at afurther small angle. Thus, an advantage that a shape of the curvedsurface can be easily fabricated is noted. When this advantage is used,the structure becomes further simpler if the two reflection surfaces ofthe same curved surface are fabricated with integrated transparent glassor plastic members.

The embodiment of this invention uses two reflection surfaces of thesame curved surface, but may combine more than two elements to relay.These can be considered within freedom of designing.

Light flux of the fisheye-type optical system of the reflection surfacewith the curved surface proposed in FIGS. 22 and 23 is efficientlysupplied to the optical system (as shown in FIG. 1 or 2) of tworeflection surfaces and is efficiently transmitted/supplied up to auser's pupil while eliminating effects of distortion and so, which iswithin a scope of this invention, and further it is possible to arrangeanother optical system on the exit side of the optical system of tworeflection surfaces and it is obvious that enhancement of freedom ofdesigning is also within the scope of this invention.

Furthermore, by way of the diffusion glass supported on a polyester filmcoated by metal oxide and metallic carbide as described above, itbecomes possible to provide a head-mounted image display device full ofrealism in correspondence to the laterally moving eyeball even byprojecting the image on the diffusion glass with the fisheye-typeoptical system projecting a picture image from the liquid crystal deviceof outputting in the two-dimensional way.

In the image display device of the embodiment of this invention, whereinthe image display device has the control device that controls the imageoutput from the first optoelectric element formed by projecting/forminglight emitted from the first optoelectric element of emitting light inthe two-dimensional way at right angles to the direction of emittinglight flux on the retina of the eyeball via the first fisheye-typeoptical system and the relay optical system, and the control deviceincludes at least one of the focus adjustment device to focus on thepredetermined wide image or the control device to control the outputarea of the wide image at will and thus due to the viewing angle of thewide image of 60 degrees and over, this invention can provide the imagedisplay device full of realism and further capable of projecting apicture image with a image display method suitable to content of animage. With this arrangement, this invention permits even a glass wearerwho usually wears glasses to view image information without usingglasses. Moreover, a necessary part of wide image information can beviewed as a wide image by digitally enlarging the part only and therebyit acts as a magnifier to a user with poor eyesight.

Also, in this image display device, the image display device further hasthe image composite device that composites the first image informationand the second image information different from the first imageinformation and outputs the composite image information from the firstoptoelectric element, so it becomes possible to display a high-visionimage, video image, DVD image, personal computer display image and thelike anywhere while viewing a wide image. Moreover, as a wide image isdisplayable, a virtual newspaper and magazine floating in an air whilepaying attention to surroundings can be read by compositing screens of anewspaper size or a magazine size.

Also, as the control device of the foregoing image display device hasthe function that optically composites the first image informationoutput from the first optoelectric element and the second imageinformation output from the second optoelectric element andprojects/forms the composite image on the retina of the eyeball, itbecomes possible to alleviate a workload against image processing of animage processing device that outputs image information to the firstoptoelectric element. Moreover, with production of reverse distortion bythe optical system between the second optoelectric element and thecontrol device to reduce distortion produced by the first fisheye-typeoptical system, image deterioration due to a distortion correction isreduced.

Also, with arrangement of the control device of the foregoing at a fixedplace along with the image processing device and transmission ofinformation to the image display device via a wireless (Infrared, radioetc), a wearable capability of the image display device can be enhanced.Furthermore, when displaying at least one of the first image informationor the second image information on the optoelectric element, a number ofoptical members can be reduced by displaying a reverse-distorted displayimage against distortion produced by the first fisheye-type opticalsystem by way of the optoelectric element so that the image displaydevice can be made lightweight.

Furthermore, at least one of the first image information or the secondimage information is a video image or information output from DVD orimage information output from a computer or information input to akeyboard, which thereby makes it possible to project desired informationcorresponding to a life style.

The desired information is information input to a portable keyboardattached to a hand and adoption of the portable keyboard as a keyboardto be attached to the image display device of this invention enables toinput the information regardless of a usage situation.

Moreover, it is preferable that the portable keyboard permits variousinformation to be entered in such a way that information of anelectromagnetic element arranged at a thumb is detected withelectromagnetic detection sensor and the information is converted intoinformation of a distance/direction of the thumb and another fingers.Also, as for other method of inputting information, information of afinger pressure each finger may be converted into recognizableinformation as an image by detecting information of the finger pressureof each finger against an object with a pressure detection sensorarranged at each finger.

Also, one of the first image information or the second image informationmay make image information by converting a voice sound or a non-voicesound input from a microphone or a headphone into a character.

As the foregoing input method has been described so far, theirexplanations will be omitted here.

The image display device as described above is made up of two imagedisplay devices that are arranged separately to the right and left eyesrespectively and a space between the two image display devices may beconfigured to be adjustable corresponding to a space between eyeballs soas to make the space between the first fisheye-type optical systems ofthe two image display devices and the space between eyeballs equal. Inthis case, when each component of the image display device isincorporated into a single box-chassis and is movable in the boxchassis, it becomes possible to project a picture image emitted from thefirst optoelectric element at the almost same space as the one betweenright and left eyes.

The image display device is made of a single image display device onlyand a space between projection images of the first fisheye-type opticalsystems may be adjustable corresponding to a space between right andleft eyes such that light flux from the first optoelectric element issplit to respective right and left eyeballs by the optical member and aspace between the first fisheye-type optical systems arranged separatelyto the respective split light flux and a space between the eyeballs aremade equal. As light flux from the first optoelectric element is splitinto a plurality of light flux by the half mirror or the polarizing beamsplitter, the single first optoelectric element makes it possible toproject a picture image having a wide viewing angle for both right andleft eyes.

The image display device includes the light diffusion member fordiffusing light that is arranged on the image-forming surface arrangedon the optical path of the optoelectric element for outputting the imagedata and the crystal ball, wherein an optical system of at least a partof the first fisheye-type optical system may form an image of an objecton the retina by converging diffused transmitted light in proximity tothe crystal ball. With this configuration, the image display deviceprojects the intermediate image on the light diffusion membertemporarily and can eliminate an existing effect of an exit pupil of theoptical system until the image is projected on the light diffusionmember again by causing the image on the light diffusion member to beformed on the retina of a user by the optical system, and this inventioncan provide the image display device dealing with the lateral movingeye.

As for the light diffusion member of diffusing light, the transparentdiffusion member that has abrasive of metal oxide or metallic carbidewhose diameters are precisely controlled in a micron grade coated on atransparent sheet is preferable and as for a material of abrasive, it ispreferable that the material be at least one of silicon carbide, chromicoxide, tin oxide, titanium oxide, magnesium oxide or aluminum oxide andit is preferable that the transparent sheet be a polyester film.

An angle of diffusion is quite large as characteristics of such thetransparent diffusion member, so it becomes possible to project a clearimage of a wide field of view by introducing an image from thetransparent diffusion member to the crystal ball of a user's eye by wayof an eyepiece lens of a fisheye type.

Well, when at least a portion of the image display device is configuredto be supported by a part rather than a user and contact a face of theuser and be movable following a face movement, it becomes possible toalleviate a wearing discomfort of the user. Especially, as shown inFIGS. 40, 41 and 42, let a XY surface be an installation surface, use ofa supporting member that causes the image display device to be movableanywhere toward a six-axis direction of X direction, Y direction, Zdirection, ΘX direction, ΘY direction and ΘZ direction permits the imagedisplay device to follow naturally a movement of a user's face.

In this case, in order to make the display device movable anywhere inthe six directions, the image display device is supported at center ofgravity of the device or in proximity to its center, so inertia to beproduced when moving the image display device can be reduced and therebya natural sense of wearing can be provided even if the face moves.

More specifically, the image display device includes a weight to balancethe image display device and the image display device may be yokedtogether with the weight by a flexible member. As the flexible membermoves by actuating the image display device, it is advisable thatfriction of s sliding portion be reduced by way of a pulley at thesliding portion of the flexible member.

The control device of controlling an output area of the wide image atwill is an optical zoom device of a variable magnification 2× and overand the sickness in VE can be reduced by controlling the output areasuch that an image composited by the first image information and thesecond image information does not overlap over a predetermined widthdepending upon a zoom status.

In addition, as the control device of controlling the output area of thewide image includes a detection member that detects a moving image of aflowing landscape on an observer's eye and a storage member thatprocesses the image such that the image does not move during apredetermined period of time and stores the processed image, thisbecomes effective in reducing the sickness in VE and thereby and furtherrealism having an impact on an observer does not need to bedeteriorated.

Furthermore, the control device of controlling the output area of thewide image includes a selection member that selects freely use ornon-use of the detection and processing/storage members and thus thisinvention can provide an image meeting a observer's will and theease-of-use image display device.

More specifically, the detection member and the storage member captureimage data into an internal buffer and image output from the internalbuffer is divided into a marginal image block and a center image block,and an amount in a lateral shift for a predetermined period of time iscomputed and judging that the shift is attributed to a hand shake or alateral movement of a screen when the edge image and center image areshifted in the same direction, the image is processed in a way thatmakes the image look as if the whole screen is still by shifting a wholeimage bit as the same amount as in a direction opposite a direction ofan image movement such that the image does not move laterally for thepredetermined period of time. This arrangement enables a reduction inthe seasick in VE.

When the forgoing is laid out, following marketability can be expectedin a case of using this invention.

<Wearable Display (94R, 94L, 102R′ and 102L′ in FIG. 30)>

A fail-safe home video camera that enables to take a picture in the sameway as a user's eye sees, transmission of an image full of realism to areceiver who is not on the spot, an device capturing a three-dimensionalimage, a portable personal computer/video game (confidentiality) with alarge display screen, a portable digital newspaper with a broad screenand a virtual reality display.

<Fixed and Remote Operated Type (102R and 102L in FIG. 30)>

Anti-crime and disaster prevention wide monitoring vision, a functionenlarging a point of an attention, an animal watching that does notbother animals, a motion image taking, transmission of a relaxationmotion image from an installation site with a good view, a broadmonitoring vision in a space where a human being cannot reach, an imageand a providing of a wide image such as a congestion status at a holidayresort and the like.

<Floor-Stand Type (FIG. 31)>

A large screen personal computer and CAD that do not feel weight andfatigue, a large scale display in place of a movie theater and aprojection, a providing of a 3-D large scale image full of realism,reception of an image from the video system via the Internet, aproviding of an image full of realism to a bed-ridden senior andpatient, a relaxation image display unit, a providing of an all-new TVvideo game image, a providing of a large screen image in a small space,a virtual reality display of highly confidential information for privateuse, a remotely operable large screen display and relaxation service fora first-class customer on board a aircraft with a reception system of adigital newspaper having a large screen.

Finally, comparison of the embodiments of this invention withconventional products on the market will be made in FIG. 49. From atable shown in the diagram, it can be seen that this invention has ahigh capabilities of implementing an excellent performance on every itemexcept for a limitation to “use in common”.

In the embodiments of this invention, specific combinations of elementsconstituting this invention have been cited herein, but any combinationof the elements is possible as needed and is included in this inventionand, more specifically, it is needless to say that claims of thisinvention can tell what kind combination thereof is included in thisinvention.

1. An image display device comprising: an optoelectric element ofemitting light in a two-dimensional way that has a display surfaceorthogonal to a direction of emitted light flux; and a fisheye-typeoptical system that projects light flux emitted from the optoelectricelement inside at least one of eyeballs of a user and has an viewingangle of 60 degrees and over, wherein the image display device is wornin front of the eyeball, wherein the fisheye-type optical system formsan intermediate image, wherein a closest optical element of opticalelements arranged toward the eyeball from an position of forming theintermediate image to the eyeball is an aspherical optical element of asingle lens element, wherein a far surface shape of the optical elementfrom the eyeball has a aspherical shape of a surface such that lightflux entering a pupil of the eyeball enters a far surface of the opticalelement from the eyeball approximately at right angles and, wherein aConic coefficient of the Conic surface is less than −1.
 2. The imagedisplay device set forth in claim 1, wherein a second optical element ofoptical elements constituting the image display device from the eyeballis made up of a single lens element and a far surface of the opticalelement from the eyeball has a shape such that the light flux enteringthe pupil of the eyeball enters a far surface of the optical elementfrom the eyeball approximately at right angles.
 3. The image displaydevice set forth in claim 1, wherein the fisheye-type optical system hasa first lens group that includes a relay optical system and an eyepiecelens system that projects the intermediate image formed by the firstlens group inside the eyeball.
 4. The image display device set forth inclaim 3, wherein the first lens group includes at least one or moreaspheric optical element and over.
 5. The image display device set forthin claim 3, wherein the first lens group includes at least one curvedmirror that corrects telecentricity. 6-39. (canceled)
 40. The imagedisplay device set forth in claim 4, wherein the first lens groupincludes at least one curved mirror that corrects telecentricity.